[WIP] Hugging Face Transformers integration

[eustlb]

Note

This PR is marked as WIP as the underlying Transformer’s PR should be merged before merging this one.

Hey there,

Thanks for the great work! It’s truly going to benefit the community 🤗
I’ve been working on integrating the model into Transformers: huggingface/transformers#34784
This integration will allow users to benefit from the improvements brought by the underlying features of the GenerationMixin‘s generate method and all its generation strategies, as well as the FA2 implementation, support for batch generation, torch.compile, and more. Additionally, this will increase the model’s visibility, as we are planning communications around both the Transformers and Transformers.js integrations.

If that aligns with your plans, we would greatly appreciate a review of the modeling file (/src/transformers/models/moonshine/modeling_moonshine.py) from your side.

Thanks for giving me access to the Hub org, I'll update the necessary from my own model repos:
https://huggingface.co/eustlb/moonshine-tiny
https://huggingface.co/eustlb/moonshine-base

[keveman]

@eustlb Thanks a lot for putting together moonshine support for the transformers repo, looks like so much effort went into that. But it will be a great reference for me going forward to add other tweaks that are in the works. I read through huggingface/transformers#34784 as best as I can. t looks good, although I have to confess my non-familiarity of Transformers code base could mean I might have missed to spot some opportunities for improvement. I would defer to your judgement on that. Please let me know if I can do anything else to speedup merging of that PR.

[eustlb]

No worries, it's mostly for you to know it's there! I've sent a slack invite to your gmail for further discussions 🤗