Running on CPU instead of GPU in an AMD system. How to fix?

[morpheuskibbe]

Hello. I have an AMD system. i got it to run by using these commands

set COMMANDLINE_ARGS=--skip-torch-cuda-test --no-half

Initially because it refused to start with no cuda. hence the skip cuda option and then because it had a runtime error mentioning "LayerNormKernelImpl" not implemented for 'Half'

It's running now but according to task manager it's running on CPU only... the GPU is not being hit in any way and predictably the performance is terrible.

what commands should I be using to get expected behavior?

[morpheuskibbe]

OH MY GOD the instructions were WRONG

The automatic installation section says
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git

It should say
git clone https://github.com/lshqqytiger/stable-diffusion-webui-directml.git

[robonxt]

Actually, if you go to the AMD installation guide, it says to use the ishqqytiger fork: https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Install-and-Run-on-AMD-GPUs

[morpheuskibbe]

yes. hence my comment about incorrect instructions. if you goto the ishqqtiger fork: https://github.com/lshqqytiger/stable-diffusion-webui-directml and scroll down to the instructions it has a copyable git clone command that points at the original, not the fork. Hence my original issue.

[Enferlain]

I cloned the directml one and it still runs on cpu 4shrug

[Aev69]

Same here. Both the original and fork just run on CPU, really defeats the purpose of using the directml one

[Ming2k8-Coder]

What your parameter in webui-user.bat Vào 09:09, T.2, 8 Th1, 2024 Aev69 ***@***.***> đã viết:

…

Same here. Both the original and fork just run on CPU, really defeats the purpose of using the directml one — Reply to this email directly, view it on GitHub <#124 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A7VS7K5LNNGMUCNG5RBKZXTYNNINDAVCNFSM6AAAAAAYGUMC2GVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DANBTGM2DE> . You are receiving this because you are subscribed to this thread.Message ID: <lshqqytiger/stable-diffusion-webui-directml/repo-discussions/124/comments/8043342 @github.com>

[diekf]

try add --use-directml

[dylanh724]

Still an issue. Adding --use-directml doesn't work, either; heck it's not even detected as a command. Confirming I'm on this fork.

[lshqqytiger]

Make sure that you are on the latest version 1.9.3.

[tonkgai]

May I ask. version 1.9.3 for what? I have the same problem! I followed this one "git clone https://github.com/lshqqytiger/stable-diffusion-webui-directml && cd stable-diffusion-webui-directml && git submodule init && git submodule update"