NimbleEdge AI Assistant is a private, fully on-device conversational AI assistant. Built on the DeliteAI platform, it delivers secure, privacy-aware, and high-performance AI experiences without compromising your data or requiring internet connectivity.
- Works without cloud processing - All AI operations happen on your device
- No internet dependency - Works offline, perfect for travel and remote locations
- Your data, your control - Clear cache and it's like you never used it
- Voice + Text Interface - Natural conversational interactions
- Speech-to-Text - On-device voice input via Google ASR or Whisper Tiny
- Intelligent Responses - Powered by quantized Llama 3.2 1B Instruct model
- Human-like Voice Output - Custom Kokoro TTS model for natural speech synthesis
- Offline AI assistance while flying or traveling
- Privacy-first interactions with AI for sensitive conversations
- Off-grid knowledge access during hiking or remote activities
- Family-friendly AI without surveillance or ads
- Personal assistant that's truly yours, not a proxy for business models
Currently available on Android
iOS version coming soon!
NimbleEdge AI Assistant leverages the DeliteAI platform's capabilities:
- On-device Model Execution via ONNX/ExecuTorch runtime
- Quantized Models for optimal performance and size
- Custom C++ Engine for seamless Python workflow execution
- Kotlin/Swift Integration for native mobile app performance
- iOS App Launch - Coming soon
- Tool Calling via MCP - Seamless integration with device and consumer apps
- Hardware Acceleration - Auto-optimized runtime for best latency and power efficiency
- Model Flexibility - Support for Gemini Nano, Qwen, Llama, and custom models
- Open Source Release - Full AI assistant code and NimbleEdge SDK
We welcome any feedback or suggestions - please join our Discord to engage with the community.
We welcome contributions from the community!
Please read our Contributing Guidelines to get started.
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.
Learn more: NimbleEdge AI Launch Blog