How to use gpt-4o with version 2024-08-06?

[zch-cc]

Select Topic Area

Question

Body

Hi Team, I want to use structure output for gpt4o and I think 2024-08-06 support that. My question is how to use it?
I tried

client = OpenAI(
                base_url="https://models.inference.ai.azure.com",
                api_key=config.LLM_TOKEN)

Does not work with error openai.BadRequestError: Error code: 400 - {'error': {'code': 'BadRequest', 'message': 'response_format value as json_schema is enabled only for api versions 2024-08-01-preview and later'}}

Also tried

client = AzureOpenAI(
                base_url="https://models.inference.ai.azure.com",
                api_key=config.LLM_TOKEN, api_version="2024-08-06")

Also does not work with 404 error
httpx HTTP Request: POST https://models.inference.ai.azure.com/deployments/gpt-4o/chat/completions?api-version=2024-08-06 "HTTP/1.1 404 Not Found"

[kevin-m-kent]

Hi - try api-version=2024-08-01-preview. This should work