Add support for CTranslate2 backend #975
lewoudar
started this conversation in
Feature requests
Replies: 1 comment
-
We could, it looks like the model forward pass is exposed with the Python bindings: https://opennmt.net/CTranslate2/python/ctranslate2.Generator.html#ctranslate2.Generator.generate_tokens. Although that would represent more work than with e.g. the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone,
first of all, I want to thank the author for this nice library.
It would be interesting if the project supports Ctranslate2. It promises some huge performance improvements.
Beta Was this translation helpful? Give feedback.
All reactions