The table summarizes vendor alternative for core AI service and optional RAI modules:
| Module | Open source | Alternative | Why to consider alternative? | More information |
|---|---|---|---|---|
| AI service | Ollama | OpenAI, Bedrock | Overall performance of the AI model, supported modalities and features | LangChain models |
| Optional: Tracing tool | Langfuse | LangSmith | Better integration with LangChain | Comparison |
| Optional: Text to speech | OpenTTS | ElevenLabs | Arguably, significantly better voice synthesis | |
| Optional: Speech to text | Whisper | OpenAI Whisper (hosted) | When suitable local GPU is not an option |
Our recommendation, if your environment allows it, is to go with OpenAI GPT4o model, ElevenLabs for TTS, locally-hosted Whisper, and Langfuse.