GenAI Ops Landscape

A curated list of GenAI Ops Projects.

GenAI Ops Tools

Guardrails AI

by

Guardrails AI

Category
Content Filtering
Prompt Engineering
What it does:
Standardize a protocol to extract information from LLM response. The protocol defines prompt, expected output, etc... If the output fails to conform the package can generate a new ask to the LLM to clarify.
Open Source:
Yes
Read more →

Guidance

by

Microsoft

Category
LLM Development Framework
What it does:
Guidance enables you to control modern language models more effectively and efficiently than traditional prompting or chaining.
Open Source:
Yes
Read more →

H20GPT

by

H20

Category
Foundation Model
What it does:
H20GPT is an open-source large language model.
Open Source:
No
Read more →

Hive-Moderation

by

Hive

Category
Content Filtering
What it does:
Machine learning models to detect AI-generated content
Open Source:
No
Read more →

HoneyHive

by

HoneyHive

Category
Prompt Engineering
Model Evaluation
Human Feedback Collection
Model Fine Tuning
Model Deployment and Hosting
What it does:
Build, evaluate and continuously improve your LLM apps in production with human feedback, quantitative rigor and safety best-practices.
Open Source:
No
Read more →

HuggingFace Chat

by

Hugging Face

Category
Foundation Model
Application-Layer
What it does:
HuggingFace Chat is an open-source large language model and a chat interface, recreating an open "chatGPT".
Open Source:
Yes
Read more →

HumanLoop

by

HumanLoop

Category
Prompt Engineering
Human Feedback Collection
What it does:
Humanloop helps developers build high-performing applications on top of large language models like GPT-3. You can use it to experiment with new prompts, collect model generated data and user feedback, and finetune models for better performance while optimising costs.
Open Source:
No
Read more →

ImageBind

by

Meta

Category
Embedding Provider
What it does:
Multi-modal embeddings.
Open Source:
Yes
Read more →

JSONformer

by

Category
Formatting Tool
What it does:
A Bulletproof Way to Generate Structured JSON from Language Models
Open Source:
Yes
Read more →