Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do I use the checkpoints from Google Cloud? #3

Open
BDHU opened this issue Jan 21, 2022 · 4 comments
Open

How do I use the checkpoints from Google Cloud? #3

BDHU opened this issue Jan 21, 2022 · 4 comments

Comments

@BDHU
Copy link

BDHU commented Jan 21, 2022

This may sound trivial. But I'd like to have some idea on how use the .data and .index file from gs://vmoe_checkpoints. Does this repo provide any scripts or code to do some evaluation/inference on those models? Any help would be appreciated.

@jpuigcerver
Copy link
Collaborator

Hi, apologies for the late reply.

To run the fine-tuning scripts, you must simply pass the corresponding file to the main.py script:

python vmoe/main.py --workdir=/tmp/foo/bar --config=vmoe/configs/vmoe_paper/vmoe_s32_last2_ilsvrc2012_randaug_light1_ft_ilsvrc2012

@BDHU
Copy link
Author

BDHU commented Apr 29, 2022

Thanks for the reply. I was able to get the fine-tuning script running. It seems to me the script is always doing training & eval. Is there any way to use the checkpoint in the workdir directly for inference? I had to hack the train_and_eval loop and disable backprop to get inference working without retraining. Any help would be appreciated:)

@jpuigcerver
Copy link
Collaborator

Unfortunately, we don't have a script for running inference alone. But it should be relatively easy to create one using the classes/functions in evaluator.py.

@Wolfboyccc
Copy link

May I ask if your evaluation function has been written and how is it written?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants