LiteLLM
LLM GatewaysOpen-source LLM gateway for routing requests across model providers.
ToolNeeds verificationOpen sourceSelf-hostedFreemiumGitHub linked
Repository · Auto enriched
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Stars and freshness are shown as source-backed signals, but this repository is still Auto enriched. Do not treat star count as a final recommendation.
GitHub stars at fetch time
Forks at fetch time
Primary language
No use-case relationships are attached yet.
Open-source LLM gateway for routing requests across model providers.