500 error

[alexa898]

i cant have access to aliyun for international users, can you update your code to work with openAi or other models

[dosubot]

Hi @alexa898! I'm Dosu and I’m helping the MiroFish team.

MiroFish does support OpenAI and other providers — but there's a known bug causing your 500 error. The system accepts any OpenAI-compatible API via .env configuration:

LLM_API_KEY=your-openai-key
LLM_BASE_URL=https://api.openai.com/v1
LLM_MODEL_NAME=gpt-4o-mini

The problem: MiroFish hardcodes response_format={"type": "json_object"} in chat_json(), which causes 500 errors with OpenAI, Groq, SiliconFlow, and other non-Aliyun providers. This has been reported multiple times including as recently as today.

Workaround: PR #186 fixes this with automatic fallback retry logic, but it hasn't been merged yet. You can manually patch backend/app/utils/llm_client.py:

def chat_json(self, messages, temperature=0.7, max_tokens=4096):
    try:
        response = self.chat(
            messages=messages,
            temperature=temperature,
            max_tokens=max_tokens,
            response_format={"type": "json_object"}
        )
    except Exception as e:
        # Retry without response_format if unsupported
        response = self.chat(
            messages=messages,
            temperature=temperature,
            max_tokens=max_tokens
        )
    # ... rest of existing JSON cleaning logic

This workaround has been tested successfully with OpenAI gpt-4o-mini.

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}