Local LLM Tools
Local LLM ToolsLocal model runners, inference servers, gateways, and self-hosted chat or agent tools.
Use caseNeeds verification
Repository · Auto enriched
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
RepositoryAuto enrichedPythonApache-2.0High starsActive signal
Ranking status
Stars and freshness are shown as source-backed signals, but this repository is still Auto enriched. Do not treat star count as a final recommendation.
82,345
GitHub stars at fetch time
17,846
Forks at fetch time
Python
Primary language
Repository signals
Mapped use cases
Related tools
No tool relationship is attached yet.