pt conver huggingface

[Dyw08]

Your work is excellent, but when I reproduced it, the weights saved during training were in PT format instead of Huggingface format. I would like to ask, is there any way to change it to Huggingface format?

[jeffreysijuntan]

You can refer to the save_checkpoint method in verl on how checkpoint is saved, I think you can indeed pass in a flag to save the whole huggingface model: https://verl.readthedocs.io/en/latest/api/utils.html#verl.utils.checkpoint.fsdp_checkpoint_manager.FSDPCheckpointManager.save_checkpoint