How use pytorch fine tunned model

[marcoaleixo]

I actually has a fine tunned pytorch model, is it possible to use that model?

[andrelmfarias]

Is your pytorch model a version of BERT?

[marcoaleixo]

Yes!

[andrelmfarias]

Did you trained your BERT model as proposed in our tutorial and do you have a .joblib version of the model?

Or did you train using pure PyTorch and have a .bin and a .config file ?

[marcoaleixo]

I just have a .bin and .config file.

[andrelmfarias]

For now it is only possible to load a .joblib version as done in our tutorials, but we are currently working on a PR (#205) to include the option to load a Reader with .bin and .config files.

[marcoaleixo]

Nice!
I don't know if it's relevant, but maybe accept the .ckpt from tensorflow weights?

[andrelmfarias]

We do not use tf models, only pytorch models from Hugging Face

But in the future we can maybe use .ckpt weights converting it to PyTorch weights to use in our PyTorch models

[marcoaleixo]

Ok!