The image quality in VLMEvalKit is compressed and lower than that provided by Benchmark itself.

[Sync-yxh]

The image quality in VLMEvalKit is compressed and lower than that provided by Benchmark itself.

[SYuan03]

Hi, @Sync-yxh
During our pre-processing, we have converted images to JPEG format. We will try to build another version that do not perform the JPEG conversion and do the evaluation again to see the gap.
We have noticed this in issues/578 and are working on building a new version.