GenAI Ops Landscape
A curated list of GenAI Ops Projects.
GenAI Ops Tools
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
LLM Observability
by
Arize
Category
Model Evaluation
Prompt Engineering
What it does:
Evaluate LLM responses, pinpoint where to improve with prompt engineering, and identify fine-tuning opportunities using vector similarity search.
Open Source:
No
LLaMA-Adapter
by
Category
Fine Tuning Framework
What it does:
Official implementation of 'LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention' and 'LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model'.
Open Source:
No
Lakera Guard
by
Lakera
Category
User-Model Supervision
Content Filtering
What it does:
A simple API to protect your LLMs
Open Source:
No
Lamini
by
Lamini
Category
Model Training
Model Fine Tuning
RLHF
What it does:
LLM engine for rapidly customizing models
Open Source:
No
LangChain
by
Category
Browser Extension
What it does:
The no-code open source chat-ai toolkit built on top of LangChain.
Open Source:
Yes
LangKit
by
WhyLabs
Category
User-Model Supervision
What it does:
Utilizing LangKit, you can continuously evaluate the LLM-powered applications using essential metrics extracted from prompts, responses, and user interactions.
Open Source:
No
Langchain-UI
by
Langchain-UI
Category
LLM Development Framework
What it does:
The no-code open source chat-ai toolkit built on top of LangChain.
Open Source:
Yes
Large Language Model Toolkit
by
Scale AI
Category
Prompt Engineering
Human Feedback Collection
What it does:
"Scale AI's LLM toolkit with three main functions: Demonstration Data: Collect human-generated text over various domains and use cases Comparison Data: Evaluate your model outputs with human feedback Trust & Safety: Align your model to produce factually correct and safe content "
Open Source:
No
Llama
by
Meta
Category
Foundation Model
What it does:
Llama is an open-source large language model.
Open Source:
Yes