Home › Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs › MLC-LLM

MLC-LLM

One row from Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs. A verified table of 40 self-hosted/offline LLM & vector-DB tools with license, min RAM/GPU, offline capability, and a source URL for every claim — so you stop reading marketing pages to find what actually runs offline.

category

LLM runtime

license

Apache-2.0

min_ram_gpu

4GB+ RAM, mobile/GPU support

offline_capable

yes

maturity

mature, active

source_url

https://github.com/mlc-ai/mlc-llm

notes

Compiles LLMs for edge/mobile/GPU

checked_on

2026-09-12