Home › Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs › Xinference

Xinference

One row from Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs. A verified table of 40 self-hosted/offline LLM & vector-DB tools with license, min RAM/GPU, offline capability, and a source URL for every claim — so you stop reading marketing pages to find what actually runs offline.

category

LLM runtime/serving

license

Apache-2.0

min_ram_gpu

depends on model size

offline_capable

yes

maturity

active

source_url

https://github.com/xorbitsai/inference

notes

Distributed inference for LLMs/embeddings

checked_on

2026-09-12