what's mplug-large

[gaotaogaotao]

Hello, when I used the script you provided to test, "loading mplug-large" was displayed, but it failed. What is mplug-large? Is there another way I can solve this problem?

[FruitPigFoot]

https://github.com/X-PLUG/mPLUG?tab=readme-ov-file
if it's the model issue, i think you can download the model from that github manually.
what's the error code you got

[gaotaogaotao]

https://github.com/X-PLUG/mPLUG?tab=readme-ov-file if it's the model issue, i think you can download the model from that github manually. what's the error code you got
The reason for the error is that the model cannot be downloaded. The link you provided shows that there are no models. Is this related to this？

[FruitPigFoot]

https://github.com/X-PLUG/mPLUG go visit the github and download it manually. But i have a feeling that your issue is about gpu or some kind of memory issue since you mentioned that error occurred while loading. Unless you post logs, i can't really figure it out

[gaotaogaotao]

https://github.com/X-PLUG/mPLUG go visit the github and download it manually. But i have a feeling that your issue is about gpu or some kind of memory issue since you mentioned that error occurred while loading. Unless you post logs, i can't really figure it out

Thank you so much, thank you for your help

[gaotaogaotao]

https://github.com/X-PLUG/mPLUG go visit the github and download it manually. But i have a feeling that your issue is about gpu or some kind of memory issue since you mentioned that error occurred while loading. Unless you post logs, i can't really figure it out

The reason for the error is that I am unable to download 'MPLUG Large', as I am unable to download the model due to network issues. So I tried to download the model and put it in the corresponding folder, but I don't know how to configure the name and location of the model?

[FruitPigFoot]

bro... those tifa codes are installed at my desktop which i don't have access to right now. I'll take a look tomorrow

[gaotaogaotao]

bro... those tifa codes are installed at my desktop which i don't have access to right now. I'll take a look tomorrow
Thank you very much for your help！

[gaotaogaotao]

bro... those tifa codes are installed at my desktop which i don't have access to right now. I'll take a look tomorrow

Thank you for sharing

[FruitPigFoot]

i checked. I'm on ubuntu so i'll describe on this os. let's say your user name is gaotao. The place for mplug will :
/home/gaotao/.cache/modelscope/hub/damo/mplug_visual-question-answering_coco_large_en/ and in this folder, you'll have something like

since tifa code uses modelscope, i suggest you remove the git cloned tifa and install it again. That would be easier instead of manually downloading and fixing the model loading codes also.

[gaotaogaotao]

i checked. I'm on ubuntu so i'll describe on this os. let's say your user name is gaotao. The place for mplug will : /home/gaotao/.cache/modelscope/hub/damo/mplug_visual-question-answering_coco_large_en/ and in this folder, you'll have something like

since tifa code uses modelscope, i suggest you remove the git cloned tifa and install it again. That would be easier instead of manually downloading and fixing the model loading codes also.

thank you