-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Model Support] Add support for wav2vec #303
Conversation
Nice, thanks |
@yaoyaoding hi My little feedback on this issue - https://github.com/egorsmkv/wav2vec2-hidet/blob/main/logs_hidet_0.3.0_and_python3.11.txt |
Hi @Aalanli, could you take a look at this? Thanks! |
Hello! Any update on it? @Aalanli |
Just tried hidet with wav2vec2-bert model recently released. Also I have some problems. I made a colab to share what's going wrong: https://colab.research.google.com/drive/1qsw0Tu9ENS_q3ao0YUbh4CDTyWqUxLWq?usp=sharing In short:
|
Hi @egorsmkv, sorry for the long delay. It turns out that implementing rand would require some invasive changes to the runtime, which we held off doing until our AMD support is ready. |
An update with hidet 0.4.1: https://github.com/egorsmkv/wav2vec2-hidet-0.4.0/blob/master/logs_hidet_0.4.1_and_python3.12.txt In short:
|
How to reproduce? PS actually it should be supported. |
https://github.com/egorsmkv/wav2vec2-hidet-0.4.0?tab=readme-ov-file#install here is the instruction to reproduce that issue. |
@egorsmkv |
Oh, okay. I'm waiting for final support of it. Luck to the team :) You do awesome work 👏 |
Major:
The example code that use hidet could be found at https://github.com/egorsmkv/wav2vec2-hidet.
Currently, hidet is still slower than pytorch (hidet 30ms vs. pytorch 25ms on RTX 4090). Will optimize these models when we have more hands.