local judge model not work, meet error when model.working()

[ylsaker]

i have followed quick start to deploy local llm as judge. But I meet this error

assert model.working(), ('MathVista evaluation requires a working OPENAI API\n' + DEBUG_MESSAGE)
^^^^^^^^^^^^^^^
AssertionError: MathVista evaluation requires a working OPENAI API

i have get the model form judge build

here is my .env
OPENAI_API_KEY=sk-123456
OPENAI_API_BASE=http://0.0.0.0:23333/v1
LOCAL_LLM=internlm/internlm2-chat-1_8b
and my deployment command is
CUDA_VISIBLE_DEVICES=3 lmdeploy serve api_server internlm/internlm2-chat-1_8b --server-port 23333
start eval command is
python run.py --data MathVista_MINI --model InternVL2_5-8B --work-dir /data/eval_result --judge internlm/internlm2-chat-1_8b --nproc 1

[kennymckormick]

Hi, the reason is that you local deployed judge model is not working. Would you please check if the api is actually working?