Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What backend to use? #2252

Open
R-Goc opened this issue Jun 21, 2024 · 0 comments
Open

What backend to use? #2252

R-Goc opened this issue Jun 21, 2024 · 0 comments

Comments

@R-Goc
Copy link

R-Goc commented Jun 21, 2024

It is not clear which backend is the optimal to use for what hardware. I have an intel core ultra 7 155h on windows. Is it better to use the openvino CPU backend or the oneMKL backend? Or would the openvino GPU backend be faster. Or should I try to make SYCL work, though there is no official support for it on windows, and it doesn't seem to be actually using the GPU. Would a quantized model with a custom audio context size make it faster than GPU on this processor? Also is it better to use base.en with default context or small.en with lowered context to make it faster?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant