Maturity mature, active: 15 tools compared (category, license, min RAM GPU)

15 of 40 rows from Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs — every row carries the source it was checked against. Click a name for its notes.

tool name	category	license	min RAM GPU	offline capable	source URL
GPT4All	LLM runtime/desktop app	MIT	8GB RAM, no GPU needed	yes	source
text-generation-webui	LLM runtime/UI	AGPL-3.0	8GB RAM, GPU optional	yes	source
LocalAI	LLM runtime/API	MIT	8GB RAM, CPU-only ok	yes	source
koboldcpp	LLM runtime	AGPL-3.0	4GB+ RAM, CPU-only ok	yes	source
text-generation-inference	LLM runtime	Apache-2.0	GPU required, 16GB+ VRAM	yes	source
MLC-LLM	LLM runtime	Apache-2.0	4GB+ RAM, mobile/GPU support	yes	source
Haystack	RAG framework	Apache-2.0	depends on backend model	yes (with local models)	source
llama-cpp-python	LLM runtime binding	MIT	4GB+ RAM, CPU-only ok	yes	source
Chroma	Vector DB	Apache-2.0	2GB+ RAM, no GPU needed	yes	source
Weaviate	Vector DB	BSD-3-Clause	4GB+ RAM, no GPU needed	yes	source
Faiss	Vector search library	MIT	depends on index size	yes	source
pgvector	Vector DB extension	PostgreSQL License	depends on Postgres config	yes	source
Vespa	Vector DB/search engine	Apache-2.0	4GB+ RAM, scalable	yes	source
RediSearch	Vector search module	RSALv2/SSPLv1 (source-available)	depends on Redis config	yes	source
Typesense	Search/vector DB	GPL-3.0	1GB+ RAM, no GPU needed	yes	source

The full verified table: Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs — 40 rows, CSV + JSON, every row with a checked source. €14 See the product

More slices of this table