You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, @Sync-yxh
During our pre-processing, we have converted images to JPEG format. We will try to build another version that do not perform the JPEG conversion and do the evaluation again to see the gap.
We have noticed this in issues/578 and are working on building a new version.
The image quality in VLMEvalKit is compressed and lower than that provided by Benchmark itself.
The text was updated successfully, but these errors were encountered: