Skip to content

Conversation

@mhbuehler
Copy link
Contributor

Description

Fixes a bug in the dataprep-multimodal-redis microservice where non-zero time metadata was being stored for .png images. This was resulting in an exception ValueError: invalid literal for int() being thrown and displayed in the MultimodalQnA UI during follow-up queries.

Issues

Related to the Image_and_Audio_Support_in_MultimodalQnA RFC

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)

Dependencies

N/A

Tests

N/A

Copy link
Contributor

@dmsuehir dmsuehir left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, I tried it out with the GenAIExamples MultimodalQnA megaservice UI and it fixed the error that I was seeing earlier. Thanks!

Copy link
Collaborator

@ashahba ashahba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ashahba ashahba added this to the v1.1 milestone Nov 14, 2024
@ashahba ashahba added the r1.1 label Nov 14, 2024
Copy link

@aice-support aice-support left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the title mentions png, but understand that it is for mp4 video file. good to put some explanations for only mp4 files supported.

@louie-tsai louie-tsai merged commit 405a632 into opea-project:main Nov 14, 2024
9 checks passed
@mhbuehler
Copy link
Contributor Author

the title mentions png, but understand that it is for mp4 video file. good to put some explanations for only mp4 files supported.

I added comments inline. The mid_time_ms variable was a very large negative number for .png files causing a crash in the UI. This fix is setting the time to 0 for all images, but leaving .mp4 videos with the original calculated time.

madison-evans pushed a commit to SAPD-Intel/GenAIComps that referenced this pull request May 12, 2025
* MultimodalQnA bugfix for follow-up query with a .png image

Signed-off-by: Melanie Buehler <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Melanie Buehler <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants