v3.3.0

🚀 LocalAI 3.3.0

What’s New in LocalAI 3.3.0 🎉

• Object detection! From 3.3.0, now LocalAI supports with a new API - also fast object detection! Just install the rfdetr-base model - See the documentation to learn more
• Backends now have defined mirrors for download - this helps when primary registries fails during download
• Bug fixes: worked hard into squashing bugfixes in this release! Ranging from container images to backends and installation scripts

The Complete Local Stack for Privacy-First AI

LocalAI	The free, Open Source OpenAI alternative. Acts as a drop-in replacement REST API compatible with OpenAI specifications for local AI inferencing. No GPU required. Link: https://github.com/mudler/LocalAI
LocalAGI	A powerful Local AI agent management platform. Serves as a drop-in replacement for OpenAI's Responses API, supercharged with advanced agentic capabilities and a no-code UI. Link: https://github.com/mudler/LocalAGI
LocalRecall	A RESTful API and knowledge base management system providing persistent memory and storage capabilities for AI agents. Designed to work alongside LocalAI and LocalAGI. Link: https://github.com/mudler/LocalRecall

Thank you! ❤️

A massive THANK YOU to our incredible community and our sponsors! LocalAI has over 34,100 stars, and LocalAGI has already rocketed past 900+ stars!

As a reminder, LocalAI is real FOSS (Free and Open Source Software) and its sibling projects are community-driven and not backed by VCs or a company. We rely on contributors donating their spare time and our sponsors to provide us the hardware! If you love open-source, privacy-first AI, please consider starring the repos, contributing code, reporting bugs, or spreading the word!

👉 Check out the reborn LocalAGI v2 today: https://github.com/mudler/LocalAGI

Full changelog 👇

👉 Click to expand 👈

What's Changed

Bug fixes 🐛

• fix(backend gallery): intel images for python-based backends, re-add exllama2 by @mudler in #5928

Exciting New Features 🎉

• feat: normalize search by @mudler in #5925
• feat(rfdetr): add object detection API by @mudler in #5923

Other Changes

• docs: ⬆️ update docs version mudler/LocalAI by @localai-bot in #5920
• chore: ⬆️ Update ggml-org/whisper.cpp to e7bf0294ec9099b5fc21f5ba969805dfb2108cea by @localai-bot in #5922
• chore: ⬆️ Update ggml-org/llama.cpp to 11dd5a44eb180e1d69fac24d3852b5222d66fb7f by @localai-bot in #5921
• chore: drop assistants endpoint by @mudler in #5926
• chore: ⬆️ Update ggml-org/llama.cpp to bf78f5439ee8e82e367674043303ebf8e92b4805 by @localai-bot in #5927

Full Changelog: v3.2.3...v3.3.0