Verification status

This tool is currently marked Needs verification. Official links, pricing, and license details are verified as community reviews pass.

Tool fit

CategoryLLM Gateways
Pricing modelFreemium
Open sourceYes
Self-hostableYes

Primary repository

RepoBerriAI/litellm
Stars49,805
LanguagePython
Last pushedJun 9, 2026

Mapped use cases

Developer Productivity AI Tools

Tools for documentation, code search, testing, review, observability, and engineering workflow acceleration.

Use caseNeeds verification

Local LLM Tools

Local model runners, inference servers, gateways, and self-hosted chat or agent tools.

Use caseNeeds verification

Related repositories

BerriAI/litellm

Python

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

RepositoryAuto enrichedPythonActive signal

Related skills

API Literacy

Engineering

Understanding authentication, rate limits, request shapes, errors, and source attribution.

Role: Recommended

SkillNeeds verificationEngineeringRequired

Backend API Design

Backend

Designing HTTP APIs, data contracts, auth boundaries, and error handling.

Role: Recommended

SkillNeeds verificationBackendRecommended

Deployment Basics

Ops

Shipping static sites, APIs, and background jobs with clear environment boundaries.

Role: Recommended

SkillNeeds verificationOpsRecommended