Local LLM Tools
Local LLM ToolsLocal model runners, inference servers, gateways, and self-hosted chat or agent tools.
Use caseNeeds verification
Tool · Needs verification
vLLM
High-throughput inference engine for serving large language models.
ToolNeeds verificationOpen sourceSelf-hostedGitHub linked
Review gate
Final scoring is withheld because this record is currently Needs verification. Official links, pricing, license, and publication summary need manual review before indexing.
Tool fit
Primary repository
Mapped use cases
Self-Hosted AI Tools
Self Hosted AI ToolsOpen-source and locally controllable AI tools for builders who need privacy, portability, or reduced vendor lock-in.
Use caseNeeds verification
Related repositories
vllm-project/vllm
PythonA high-throughput and memory-efficient inference and serving engine for LLMs
RepositoryAuto enrichedPythonApache-2.0High starsActive signal
Related skills
Shipping static sites, APIs, and background jobs with clear environment boundaries.
Role: Recommended
SkillNeeds verificationOpsRecommended
Docker
OpsContainerizing and running tools consistently across local and server environments.
Role: Recommended
SkillNeeds verificationOpsOptional
Running local models, choosing model sizes, managing inference servers, and monitoring resources.
Role: Recommended
SkillNeeds verificationAIRecommended