.Net HuggingFace ImageToTextService returns 503 (Service Temporarily Unavailable)

[akordowski]

Hi all! I am trying to invoke the microsoft/OmniParser-v2.0 model using the Hugging Face connector.

var kernel = Kernel
    .CreateBuilder()
    .AddHuggingFaceImageToText("microsoft/OmniParser-v2.0", apiKey: apiKey)
    .Build();

var service = kernel.GetRequiredService<IImageToTextService>();

var imageBinary = File.ReadAllBytes(image);
var imageContent = new ImageContent(imageBinary, mimeType);
var textContent = await service.GetTextContentsAsync(imageContent);

This example returns an 503 (Service Temporarily Unavailable) error. The docs recommends to set the WaitForModel property to true in this case, but this has no effect and I still get the 503 error.

var kernel = Kernel
    .CreateBuilder()
    .AddHuggingFaceImageToText("microsoft/OmniParser-v2.0", apiKey: apiKey)
    .Build();

var service = kernel.GetRequiredService<IImageToTextService>();

var imageBinary = File.ReadAllBytes(image);
var imageContent = new ImageContent(imageBinary, mimeType);
var promptExecutionSettings = new HuggingFacePromptExecutionSettings();

IReadOnlyList<TextContent> textContent = new List<TextContent>();

try
{
    textContent = await service.GetTextContentsAsync(imageContent, promptExecutionSettings);
}
catch (Exception ex)
{
    promptExecutionSettings.WaitForModel = true;
    textContent = await service.GetTextContentsAsync(imageContent, promptExecutionSettings);
}

When I switch the model to Salesforce/blip-image-captioning-base the above example works fine and I get a result. Any idea how to solve this problem? Any help is appreciated.

[sophialagerkranspandey]

Hi, the issue you're encountering is on the service side of HuggingFace. We'd recommend contacting them to help with the 503 error as it isn't related to Semantic Kernel, thanks.