Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ONNX und Olive tabs not available in the UI #402

Open
4 of 6 tasks
MetalaSD opened this issue Mar 2, 2024 · 2 comments
Open
4 of 6 tasks

ONNX und Olive tabs not available in the UI #402

MetalaSD opened this issue Mar 2, 2024 · 2 comments
Labels
duplicate This issue or pull request already exists not an issue

Comments

@MetalaSD
Copy link

MetalaSD commented Mar 2, 2024

Checklist

  • The issue exists after disabling all extensions
  • The issue exists on a clean installation of webui
  • The issue is caused by an extension, but I believe it is caused by a bug in the webui
  • The issue exists in the current version of the webui
  • The issue has not been reported before recently
  • The issue has been reported before but has not been fixed yet

What happened?

After installing the latest WebUI Version from this fork (multimple times), I get the UI running, but there's no ONNX or Olive Tabs so I can't optimize the models and the performance on a RX6800XT is bad (1.3s/it for a 512). I am on Windown 10, using the latest AMD drivers.

Steps to reproduce the problem

I was using the official installation guide here, and after encountering some non-expected problems with "torch no gpu found", etc, looked for help to solve them elsewhere (reddit, youtube). Now having the UI working, the ONNX and OOlive tabs are gone. The Model is doing whaat it is supposed to do, using the GPU, but it is slow.
When I "enable" onnx from the settings, all I get is an error for missing required arguments, if I try to generate something - which I suppose is due to the fact the models are not optimized for it.

What should have happened?

It should have included both the ONNX and Olive Tabs as expected.
screen webui

What browsers do you use to access the UI ?

Google Chrome

Sysinfo

Console logs

venv "D:\SD\stable-diffusion-webui-directml\venv\Scripts\Python.exe"
fatal: No names found, cannot describe anything.
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: 1.7.0
Commit hash: 77c0e5f2e7f6e1f81f3a7477484a03f521465f7a
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
D:\SD\stable-diffusion-webui-directml\venv\lib\site-packages\pytorch_lightning\utilities\distributed.py:258: LightningDeprecationWarning: `pytorch_lightning.utilities.distributed.rank_zero_only` has been deprecated in v1.8.1 and will be removed in v2.0.0. You can import it from `pytorch_lightning.utilities` instead.
  rank_zero_deprecation(
Launching Web UI with arguments: --use-directml
Style database not found: D:\SD\stable-diffusion-webui-directml\styles.csv
ONNX: selected=DmlExecutionProvider, available=['DmlExecutionProvider', 'CPUExecutionProvider']
Loading weights [6ce0161689] from D:\SD\stable-diffusion-webui-directml\models\Stable-diffusion\v1-5-pruned-emaonly.safetensors
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Creating model from config: D:\SD\stable-diffusion-webui-directml\configs\v1-inference.yaml
Startup time: 15.4s (initial startup: 0.1s, prepare environment: 43.1s, initialize shared: 8.4s, load scripts: 1.9s, reload hypernetworks: 0.1s, create ui: 1.0s, gradio launch: 3.2s).
Applying attention optimization: InvokeAI... done.
Model loaded in 150.3s (load weights from disk: 4.2s, create model: 1.4s, apply weights to model: 142.5s, apply half(): 0.7s, move model to device: 0.1s, load textual inversion embeddings: 0.2s, calculate empty prompt: 1.1s).

Additional information

Latest AMD Drivers: 24.2.1
Windows 10, fully up to date

@Lethaquell
Copy link

Same here

@lshqqytiger
Copy link
Owner

#372 #375

@lshqqytiger lshqqytiger added duplicate This issue or pull request already exists not an issue labels Mar 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate This issue or pull request already exists not an issue
Projects
None yet
Development

No branches or pull requests

3 participants