LLM Gateways resources

2 resources

LiteLLM

LLM Gateways

Open-source LLM gateway for routing requests across model providers.

ToolNeeds verificationOpen sourceSelf-hostedFreemiumGitHub linked

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

RepositoryAuto enrichedPythonActive signal