flutter_edge_ai

On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

Automatically checked · GitHub checked 2026-11-14

flutter_edge_ai

Overview

Flutter Edge AI

pub package License: MIT

On-device AI for Flutter on Android, iOS, Web, macOS, Windows and Linux. Run any model a registered engine runs, or the model the operating system already ships, with text, vision, audio, function calling, embeddings, RAG and speech. No server, no cloud.

Website · Docs · Models · Codelabs · pub.dev

The core package is small: it installs models and hands them to engines. Every runtime, store and feature is a separate opt-in package, so an app ships only what it uses. Start with the core README or Getting started.

Packages

PackageWhat it doesDocs
flutter_edge_aiCore: model installation, the engine registry, sessions and chat. Required by every package except diagnostics and genkit_hybrid.pub.dev · site
Engines
flutter_edge_ai_litertlmLiteRT-LM (.litertlm) through dart:ffi on the five native platforms plus web; CPU, GPU and NPU; the LiteRT embedding backend.pub.dev · site
flutter_edge_ai_mediapipeMediaPipe (.task) on Android, iOS and web. Google's LLM Inference API is maintenance-only; new apps should use .litertlm.pub.dev · site
flutter_edge_ai_llamallama.cpp (.gguf) through llamadart on Android, iOS, macOS, Windows, Linux and web; native LoRA.pub.dev · site
flutter_edge_ai_onnxONNX Runtime: GenAI inference and embeddings natively, Transformers.js and onnxruntime-web on web.pub.dev · site
flutter_edge_ai_builtin_aiThe OS model, nothing to download: Gemini Nano (Android), Apple Foundation Models (iOS, macOS), Windows AI Foundry, the browser Prompt API.pub.dev · site
Embeddings and RAG
flutter_edge_ai_embeddingsEmbedding tokenizers (Gemma SentencePiece, BERT WordPiece) for .tflite and .onnx embedders.pub.dev · site
flutter_edge_ai_ragOn-device RAG: RagIndex, embedding profiles, filters and the vector-store contract.pub.dev · site
flutter_edge_ai_sqliteSQLite (sqlite-vec) vector store on every platform, web included.pub.dev · site
flutter_edge_ai_qdrantQdrant Edge vector store on native platforms.pub.dev · site
Speech, agents, diagnostics
flutter_edge_ai_speechSpeech-to-text, text-to-speech and the VoiceSession voice loop.pub.dev · site
flutter_edge_ai_agentAgent skills (SKILL.md) the model picks and runs: text, JS, native intents and MCP tools.pub.dev · site
flutter_edge_ai_diagnosticsProcess memory diagnostics on Android, iOS, macOS, Linux and Windows.pub.dev · site
Genkit
genkit_flutter_edge_aiGenkit Dart plugin: on-device models and embedders as Genkit models.pub.dev · site
genkit_hybridHybrid routing for Genkit: on-device and cloud models behind one routing policy. Depends only on genkit.pub.dev · site

Which package you need for which task, and how they fit together: Packages and Capabilities.

Maintainers

MaintainerLooks after
Sasha Denisov (@DenisovAV)Lead maintainer: the core API, the engines, the native builds and every release
Jhin Lee (@leehack)flutter_edge_ai_llama
Francesco Vezzani (@kekko7072)flutter_edge_ai_builtin_ai
Samarthsinh Vala (@samarthsinh2660)flutter_edge_ai_diagnostics
Daisuke Majima (@john-rocky)The Hugging Face integration: installing a model straight from its repository

Everyone else who has contributed, and more about each maintainer: flutteredge.ai/contributors.

Repository

More: Migration guide · Desktop support · Contributing. The family shipped as flutter_gemma* up to core 1.11.4; those names stay published as they are.

License

MIT — see LICENSE.