FORGED GOODSsmall, specific, verified digital tools

HomeLocal-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs › mature, very active

Maturity mature, very active: 8 tools compared (category, license, min RAM GPU)

8 of 40 rows from Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs — every row carries the source it was checked against. Click a name for its notes.

tool namecategorylicensemin RAM GPUoffline capablesource URL
llama.cppLLM runtimeMIT4GB+ RAM, CPU-only okyessource
OllamaLLM runtimeMIT8GB RAM for 7B modelsyessource
vLLMLLM runtimeApache-2.016GB+ GPU VRAM recommendedyessource
LangChainRAG frameworkMITdepends on backend modelyes (with local models)source
LlamaIndexRAG frameworkMITdepends on backend modelyes (with local models)source
QdrantVector DBApache-2.02GB+ RAM, no GPU neededyessource
MilvusVector DBApache-2.08GB+ RAM recommendedyessource
ElasticsearchSearch/vector DBElastic License 2.0/AGPL-3.0 dual4GB+ RAM, scalableyessource
The full verified table: Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs — 40 rows, CSV + JSON, every row with a checked source. €14   See the product
More slices of this table