Plans for making codebase compatible with newer versions of Huggingface transformers

[KeremZaman]

Is there any plan to update codebase to make it compatible with newer versions of HF transformers? When I try to run an evaluation for my custom model which is trained with newer versions, the older version of HF cannot load the weights.

Since there are major differences in transformer API between two versions, I cannot use the same code with the newer versions. Considering wide-usage of HF, it'd be great to make a transition to new versions.

If this sounds okay, I can send a PR for this purpose but it will take time to make sure everything is working correctly.

[sebastianruder]

That would be awesome! I've been planning to do that but haven't had the bandwidth so far. I'd be happy to help once I have a bit more capacity.

[melvinjosej]

Yeah thanks for offering to work on this!

[melvinjosej]

Hi @KeremZaman,

I'm curious to see if you've made any progress on this.

[KeremZaman]

Hey @melvinjosej ,
Sorry, I couldn't find any time for that after opening the issue. Probably I can look at it in end of November - beginning of December if it's okay for you.