-
Notifications
You must be signed in to change notification settings - Fork 132
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
not using gpu #76
Comments
What version of python ate you using? This issue can occur when using an outdated python version. I know that Python 3.11.4 works for certain. 3.10 does not work. |
i have python 3.11.4 |
Hi @xxopenxx. Are you on Windows 10 or Windows 11? because onnxruntime-directml (the AI engine) is only compatible with this OS. Otherwhise it will use the CPU |
WINDOWS 10 |
Python 3.10.14, I never had problem with any ai open source apps, like stable diffusion, ollama etc |
@xxopenxx can you send your PC specs? (Task manager / performance tab) |
i5 12400f, rtx 4070 12gb vram, 16gb ram |
Have you installed Visual C Redistributable and DXRuntime?
typically should already be installed |
These 2 things already installed |
Strange, are you sure it is not using your gpu? the temperature is "normal" while upscaling? Also, if you are on Python, you should see an error that says "onnxruntime will use CPU" in the terminal |
i dont have that error, there are no errors at all in terminal of quality scaler |
Are you selecting "High performance" GPU in the options right? and if you select Power saving? |
wait.... do you have python 3.10.14 or 3.11.4? Because this looks an awfully lot like this issue #69 |
Hi my friend, maibe you do not see the correct "graph". In fact, you are seeing only "Video encode" e "Video decode", but there are more options. To see if the gpu is being used, you have to switch to "3D" graph. Also, you can use VsCode to run QualityScaler.py and you should see all logs |
But while im using stable diffusion and im upscaling photo for example, I have 99% gpu usage in task manager, it's same for ollama and video diffusion. Upscaling using qualityscaler takes 2h to upscale 2minutes video from 360 p to 760p, using multihreading |
sorry but, just a stupid question, have you installed the correct dependencies in requirements.txt? |
i can share screen on discord or something like that if you want |
can you unistall everything and re-install? i think there is some problem somewere because the latest version of onnxruntime-directml is 1.17.3, but you have 1.17.0
|
@Djdefrag Can I run it if I don't have GPU ? |
Hi my friend, yes, it will run without GPU, but will be really slow. Maibe you can try using the lightest AI model, RealSR_Gx4 |
Hello - I have the same issue. From both steam app and version 3.6 from github. The symptom is that CPU is peak and no GPU usage (no memory allocation, CUDA is low % (e.g. 0-5% same as GPU). I found this on stack and tried the script. Mine say, "CPU-DML". Is that correct? I also check python package and it is using
|
ok - some update. installed onnxruntime-gpu and onnxruntime (cpu) and tried to use it. It turned out that estimates say 19hrs+ rather than 30mins with onnxruntime-directml. Then, I look at GPU temperature, and temp is a bit higher than usual (70C). So, I guess, task manager may not report the right GPU metrics? |
Hi my friend, yes, with Nvidia GPU Task manager does not visualize "AI processing" by default. You have to select the correct Voice from the graph menu, probably Compute 0 or High priority 3D |
Hi my friend, usually Half precision is faster, i reccomend use Full precision only for old gpus (which are not compatible with Half precision). For Nvidia gpu's, Task Manager does not show GPU usage for AI processing by default. It should show it in one of these graphs, but I don't know which one because I don't have an Nvidia GPU :( In any case, it is also useful to look at the GPU temperature, to see if it is being used. If the temperature is high, it means it is being used properly. |
For me, it shows as Graphic_1 above which is running around 67%. I don't have High priority 3D. Do you have recommendation on interpolation? I noticed improvement selecting "None". However, I don't know if it's happening in every frame. btw, I solved the GPU/CPU not fully used problem. I made change to allow 6 threads, now GPU goes up around 80%, I think VRAM is 1GB more and CPU is bounded :). It's reduced1.5 hours of 5 hrs processing with 4 threads. I think Real-ESRGAN can use high # of thread setting. But ESRGAN, will burn out my CPU much quicker. Thanks for the note on watching CPU/GPU temp on the app, that's how I found out. |
Hi, it's using 100% of my cpu and 0% of gpu all the time, memory is 0.0gb too
The text was updated successfully, but these errors were encountered: