Self-Hosted AI Tools | AI Builder Resource Map

Publication status

This page is generated from the seed database and is marked Needs verification. It is useful for local discovery, but final public ranking and indexing should wait for manual source review.

Start here

Move from problem framing to a shortlist by checking required skills first, then tools, repositories, MCP resources, and caveats.

Skills

12 mapped skills

Tools

13 candidate tools

Repos

3 GitHub records

Required and useful skills

API Literacy

Engineering

Understanding authentication, rate limits, request shapes, errors, and source attribution.

Skill linked from curated resource requirements.

SkillNeeds verificationEngineeringRequired

Command Line

Engineering

Using terminal commands, package managers, environment variables, and logs.

Skill linked from curated resource requirements.

SkillNeeds verificationEngineeringRequired

Data Ingestion

Data

Loading, cleaning, chunking, and normalizing documents or structured data.

Skill linked from curated resource requirements.

SkillNeeds verificationDataRequired

Data Privacy

Governance

Handling private code, prompts, logs, documents, and user data safely.

Skill linked from curated resource requirements.

SkillNeeds verificationGovernanceRequired

Deployment Basics

Ops

Shipping static sites, APIs, and background jobs with clear environment boundaries.

Required or useful skill for resources in this use case.

SkillNeeds verificationOpsRecommended

Docker

Ops

Containerizing and running tools consistently across local and server environments.

Skill linked from curated resource requirements.

SkillNeeds verificationOpsOptional

Evaluation

Quality

Testing LLM quality, retrieval quality, task completion, and regression behavior.

Skill linked from curated resource requirements.

SkillNeeds verificationQualityRecommended

Local Model Ops

Running local models, choosing model sizes, managing inference servers, and monitoring resources.

Skill linked from curated resource requirements.

SkillNeeds verificationAIRecommended

Python

Programming

General Python programming for automation, data, AI, and backend scripts.

Required or useful skill for resources in this use case.

SkillNeeds verificationProgrammingRequired

Retrieval-Augmented Generation

Connecting LLMs to external knowledge with retrieval, ranking, and grounded responses.

Required or useful skill for resources in this use case.

SkillNeeds verificationAIRequired

Self-Hosting Basics

Ops

Running open-source tools locally or on controlled infrastructure.

Skill linked from curated resource requirements.

SkillNeeds verificationOpsOptional

Vector Databases

Data

Indexing and retrieving embeddings for semantic search and RAG applications.

Required or useful skill for resources in this use case.

SkillNeeds verificationDataRecommended

Recommended tools

AnythingLLM

RAG App Platforms

Self-hosted workspace and RAG interface for documents and LLM workflows.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedFreemiumGitHub linked

Chroma

Vector Databases

Embedding database commonly used for local and application-level RAG prototypes.

Seeded from manual curation; metadata enriched where possible.

ToolNeeds verificationOpen sourceSelf-hostedFreemiumGitHub linked

Jan

Local LLM Tools

Open-source desktop AI assistant for local model workflows.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

llama.cpp

Local LLM Tools

Core local inference project for running LLMs efficiently on local hardware.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

LocalAI

Local LLM Tools

Open-source local inference server compatible with OpenAI-style APIs.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

Open WebUI

Local LLM Tools

Self-hosted AI chat interface for local and remote models.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

Qdrant

Vector Databases

Vector database for semantic search and retrieval-heavy AI applications.

Seeded from manual curation; metadata enriched where possible.

ToolNeeds verificationOpen sourceSelf-hostedFreemiumGitHub linked

RAGFlow

RAG App Platforms

Open-source RAG engine focused on document understanding and retrieval workflows.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

vLLM

Local LLM Tools

High-throughput inference engine for serving large language models.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

LibreChat

Local LLM Tools

Open-source AI chat platform with multi-provider support.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

LobeChat

Local LLM Tools

Open-source AI chat and agent interface for model and plugin workflows.

Curated tool relationship for future one-stop directory pages.

ToolNeeds verificationOpen sourceSelf-hostedFreemiumGitHub linked

Milvus

Vector Databases

Open-source vector database for large-scale similarity search and AI retrieval systems.

Seeded from manual curation; metadata enriched where possible.

ToolNeeds verificationOpen sourceSelf-hostedGitHub linked

Repository candidates

qdrant/qdrant

Rust

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Official GitHub repository metadata fetched where API allowed.

RepositoryAuto enrichedRustApache-2.0Active signal

chroma-core/chroma

Rust

Search infrastructure for AI

Official GitHub repository metadata fetched where API allowed.

RepositoryAuto enrichedRustApache-2.0Active signal

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Official GitHub repository metadata fetched where API allowed.

RepositoryAuto enrichedGoApache-2.0Active signal

Caveats and failure modes

Records are useful for discovery but still need source, license, pricing, and summary review before public ranking.