AI tools

Explore assistants, agents, and tools for working with AI models.

771 results

A fully functional AI Agent desktop client that supports Webui access and can be creatively customized and expanded!

GitHub stars
2,266
License
MIT
Last commit
2026-11-17
AI tools

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.

GitHub stars
1,930
License
MIT
Last commit
2024-03-22
AI tools

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

GitHub stars
161
License
MIT
Last commit
2026-11-17
AI tools

A self-hosted, offline, ChatGPT-like chatbot, powered by Llama 2.

GitHub stars
10,923
License
MIT
Last commit
2024-04-23
AI tools

User friendly GUI for configuring and launching llama.cpp

GitHub stars
142
License
GPL-3.0
Last commit
2026-11-13
AI tools

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

GitHub stars
387
License
MIT
Last commit
2026-11-14
AI tools

LLM4S appears in the LLM API Gateways & Local Inference collection alongside widely adopted projects such as Ollama, vLLM, LiteLLM, and Vercel AI SDK.

GitHub stars
279
License
MIT
Last commit
2026-11-15
AI tools

State of the art inference performance with modern accelerators on Kubernetes

GitHub stars
5,295
License
Apache-2.0
Last commit
2026-11-18
AI tools

Manifest LLM Gateway is an open-source LLM gateway for AI agents and apps.

GitHub stars
7,636
License
MIT
Last commit
2026-11-12
AI tools

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

GitHub stars
506
License
Apache-2.0
Last commit
2026-11-09
AI tools

Everything you need to know about LLM inference

GitHub stars
483
License
Apache-2.0
Last commit
2026-11-12
AI tools

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

GitHub stars
266
License
Apache-2.0
Last commit
2026-11-12
AI tools

The .NET library to build AI agents with 30+ built-in connectors.

GitHub stars
654
License
MIT
Last commit
2026-11-13
AI tools

Harness engineering applied to knowledge production: a self-evolving multi-agent newsroom that turns your documents into a cross-linked markdown wiki. A "reground" loop pulls published pages back in before they go stale — writer ≠ reviewer, local-first, a structured alternative to RAG.

GitHub stars
175
License
MIT
Last commit
2026-11-10
AI tools

Turn your documents into a Markdown wiki you can read, that answers with citations. Works with any LLM provider, Ollama included. CROW: 99.5% right note read vs 79%, 1.6× faster ingest, 63% fewer LLM tokens, no scaling limit.

GitHub stars
255
License
AGPL-3.0
Last commit
2026-11-13
AI tools

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

GitHub stars
8,141
License
Apache-2.0
Last commit
2026-11-13
AI tools

Open-source control plane and runtime for organisational agents: shared company context & brain

GitHub stars
234
License
Apache-2.0
Last commit
2026-11-12
AI tools

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

GitHub stars
50,415
License
MIT
Last commit
2026-11-17
AI tools

Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.

GitHub stars
157
License
GPL-3.0
Last commit
2026-11-13
AI tools

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

GitHub stars
4,359
License
AGPL-3.0
Last commit
2026-11-17
AI tools

A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers

GitHub stars
321
License
MIT
Last commit
2026-11-09
AI tools

All keys can be changed or unbound under Hotkeys on the settings page.

GitHub stars
138
License
MIT
Last commit
2026-11-14
AI tools

33 battle-tested skills + minimal .claude harness for any coding agent (Claude Code, Cursor, Codex, Gemini CLI).

GitHub stars
759
License
MIT
Last commit
2026-07-14
AI tools

Imagine Telegram but single person, with agents, and end-to-end encrypted. Alternative to Grok bot, Muse, Dots

GitHub stars
372
License
GPL-3.0
Last commit
2026-11-13
AI tools