Use case · Needs verification
RAG Frameworks
Retrieval-augmented generation frameworks, vector databases, and data tooling for knowledge-connected LLM apps.
Verification status
This page lists recommended resources for this use case and is marked Needs verification. Community contributions and verification status are updated regularly.
Start here
Browse recommended tools and libraries to speed up your build.
Skills
15 mapped skills
Tools
19 candidate tools
Repos
20 GitHub records
Required and useful skills
API Literacy
EngineeringUnderstanding authentication, rate limits, request shapes, errors, and source attribution.
Required or useful skill for resources in this use case.
Data Ingestion
DataLoading, cleaning, chunking, and normalizing documents or structured data.
Required or useful skill for resources in this use case.
Data Privacy
GovernanceHandling private code, prompts, logs, documents, and user data safely.
Skill linked from curated resource requirements.
Deployment Basics
OpsShipping static sites, APIs, and background jobs with clear environment boundaries.
Required or useful skill for resources in this use case.
Documentation Writing
DocumentationWriting concise setup, usage, troubleshooting, and reference documentation.
Skill linked from curated resource requirements.
Evaluation
QualityTesting LLM quality, retrieval quality, task completion, and regression behavior.
Required or useful skill for resources in this use case.
Frontend Development
WebBuilding usable interfaces with component systems, routing, and responsive layouts.
Skill linked from curated resource requirements.
LLM Application Architecture
AIDesigning data flow, model calls, tools, memory, and evaluation boundaries.
Required or useful skill for resources in this use case.
Prompt Design
AIStructuring instructions, context, and examples for reliable AI outputs.
Required or useful skill for resources in this use case.
Python
ProgrammingGeneral Python programming for automation, data, AI, and backend scripts.
Required or useful skill for resources in this use case.
Retrieval-Augmented Generation
AIConnecting LLMs to external knowledge with retrieval, ranking, and grounded responses.
Required or useful skill for resources in this use case.
Self-Hosting Basics
OpsRunning open-source tools locally or on controlled infrastructure.
Required or useful skill for resources in this use case.
Recommended tools
AnythingLLM
RAG App PlatformsSelf-hosted workspace and RAG interface for documents and LLM workflows.
Curated tool relationship for future one-stop directory pages.
Chainlit
AI App FrameworksOpen-source Python framework for building conversational AI interfaces.
Curated tool relationship for future one-stop directory pages.
Chroma
Vector DatabasesEmbedding database commonly used for local and application-level RAG prototypes.
Seeded from manual curation; metadata enriched where possible.
Crawl4AI
Scraping Crawling ToolsOpen-source crawler and scraper designed for LLM-friendly web extraction.
Curated tool relationship for future one-stop directory pages.
Dify
RAG App PlatformsOpen-source platform for building LLM apps, agents, workflows, and RAG systems.
Curated tool relationship for future one-stop directory pages.
Firecrawl
Scraping Crawling ToolsTool and API for turning websites into LLM-ready markdown or structured data.
Curated tool relationship for future one-stop directory pages.
Flowise
RAG App PlatformsLow-code visual builder for LLM apps, agent flows, and RAG workflows.
Curated tool relationship for future one-stop directory pages.
Haystack
RAG FrameworksOpen-source framework for building production-style search, RAG, and NLP pipelines.
Seeded from manual curation; metadata enriched where possible.
LangChain
AI Agent FrameworksFramework ecosystem for building LLM applications, agents, and RAG workflows.
Seeded from manual curation; metadata enriched where possible.
Langflow
RAG App PlatformsVisual framework for building LLM apps, agents, and RAG pipelines.
Curated tool relationship for future one-stop directory pages.
LangGraph
AI Agent FrameworksFramework for building stateful, controllable LLM agent workflows.
Curated tool relationship for future one-stop directory pages.
LlamaIndex
RAG FrameworksFramework focused on connecting private or domain data to LLM applications.
Seeded from manual curation; metadata enriched where possible.
Repository candidates
ollama/ollama
GoGet up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Official GitHub repository metadata fetched where API allowed.
langchain-ai/langchain
PythonThe agent engineering platform.
Official GitHub repository metadata fetched where API allowed.
run-llama/llama_index
PythonLlamaIndex is the leading document agent and OCR platform
Official GitHub repository metadata fetched where API allowed.
qdrant/qdrant
RustQdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Official GitHub repository metadata fetched where API allowed.
chroma-core/chroma
RustSearch infrastructure for AI
Official GitHub repository metadata fetched where API allowed.
deepset-ai/haystack
MDXOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Official GitHub repository metadata fetched where API allowed.
milvus-io/milvus
GoMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search
Official GitHub repository metadata fetched where API allowed.
langgenius/dify
TypescriptProduction-ready platform for agentic workflow development.
High-star GitHub discovery seed from query `topic:rag stars:>1000`.
open-webui/open-webui
PythonUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
High-star GitHub discovery seed from query `topic:rag stars:>1000`.
Shubhamsaboo/awesome-llm-apps
Python100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
High-star GitHub discovery seed from query `topic:rag stars:>1000`.
infiniflow/ragflow
PythonRAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
High-star GitHub discovery seed from query `topic:rag stars:>1000`.
PaddlePaddle/PaddleOCR
PythonTurn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
High-star GitHub discovery seed from query `topic:rag stars:>1000`.
Caveats and failure modes
Resource verification status and scoring are reviewed regularly to maintain directory accuracy.