Evaluate mse aligned multilingual clip

[rom1504]

https://github.com/FreddeFrallan/Multilingual-CLIP

should be possible to add it simularly to https://github.com/LAION-AI/CLIP_benchmark/blob/main/clip_benchmark/models/japanese_clip.py

do you want to give it a try @FreddeFrallan ?

I'm still quite curious on how mse aligned mclip compared with the contrastive one

[FreddeFrallan]

I'm on it!

[rom1504]

So results were interestingly quite poor

The mystery of multilingual gap in imagenet top1 zero shot remains

Probably error analysis per class would help