SGLang

One row from Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs. A verified table of 40 self-hosted/offline LLM & vector-DB tools with license, min RAM/GPU, offline capability, and a source URL for every claim — so you stop reading marketing pages to find what actually runs offline.

category: LLM runtime
license: Apache-2.0
min_ram_gpu: GPU required, 16GB+ VRAM
offline_capable: yes
maturity: active
source_url: https://github.com/sgl-project/sglang
notes: Fast structured LLM programs/serving
checked_on: 2026-09-12

The full verified table: Local-AI Stack Directory: 40 Self-Hosted LLM & Vector-DB Tools, Verified Specs — 40 rows, CSV + JSON, every row with a checked source. €14 See the product

Also in this table

Text Embeddings Inference
Chroma
Qdrant
Weaviate
Open WebUI
Xinference
OpenLLM
llama-cpp-python

Compare

SGLang vs Text Embeddings Inference