AI Observability Evaluation

Observability and debugging platform for AI agents.

Open-source observability and evaluation tool for LLM and ML applications.

Open-source observability platform for LLM usage, latency, and cost tracking.

Open-source LLM observability and tracing platform.

Open-source tool for testing, evaluating, and red-teaming prompts and LLM apps.

Evaluation framework for RAG and LLM application quality checks.

AI Observability & Evaluation

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI