matrixhub
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
Automatically checked · GitHub checked 2026-11-14
Overview
MatrixHub
MatrixHub is an open-source, self-hosted AI model registry engineered for large-scale enterprise inference. It serves as a drop-in private replacement for Hugging Face, purpose-built to accelerate vLLM and SGLang workloads.
For target users, use cases, and current capabilities, see the Overview.
🌐 Live Demo
Try MatrixHub instantly at demo.matrixhub.ai — no setup required.
Sign in with the public demo credentials:
| Username | Password |
|---|---|
admin | changeme |
The demo is for evaluation only and may be reset at any time.
🚀 Quick Start
Follow the Getting Started guide to deploy MatrixHub and cache your first model.
For Docker Compose and Helm commands, see Installation.
For vLLM, SGLang, llm-d, Dynamo, and model distribution examples, see the Integrations guide.
Contributing and Development
We welcome contributions.
All community participants are expected to follow the CNCF Code of Conduct.
See CONTRIBUTING.md for issues, pull requests, reviews, DCO, and release note requirements.
See Development Guide for local setup, testing, and generated code.
See Technical Design Docs for architecture and feature designs.
Community and Support
Join us in GitHub Discussions
or the CNCF Slack #matrixhub
for questions, ideas, and support.
Security
Please report vulnerabilities according to SECURITY.md.
License
MatrixHub is licensed under the Apache License 2.0.