The result cannot be achieved using official checkpoint.

[ongjiahao]

Hello, I use the official checkpoint 1750 of cashew in VisA, but I cannot get the same results in the paper. Is there something wrong in my experiment? Below is my experimental setup.

[ongjiahao]

Below is my experimental setup.

[ongjiahao]

Below is my experimental setup.

[arimousa]

Hi can you change test_batch_size to 32

[Jay-zzcoder]

Sorry, even if bs is set to 32, the results still can't reach the reported metrics