New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Possible to abort transcription? #984

Open

mariano54 opened this issue Aug 31, 2024 · 1 comment

mariano54 commented Aug 31, 2024

I am performing a large number of transcriptions on limited GPU space.

I would like to cancel the model forwarding as soon as I know that I won't need the result. Is it possible to do this with faster-whisper?

If not, can you help guide me to where I'm Ctranslate2 I would need to modify to add this feature?

Thank you for your great work.

Collaborator

MahmoudAshraf97 commented Sep 3, 2024

you can use multithreading, one thread per transcription using the same model instance, and kill the thread when you don't need it anymore

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment