SDXL 5700XT #205

Rizzlord · 2023-07-26T20:08:22Z

Rizzlord
Jul 26, 2023

So i gues we have no chance creating images at 1024x1024 with 8gb vram.... max i would get was 768x768... i hope something with onnx olive with work out.. although my optimize Tab for Olive is missing since the latest update...

lshqqytiger · 2023-07-27T03:37:15Z

lshqqytiger
Jul 27, 2023
Maintainer

Olive tab requires --olive argument. It is hidden without --olive.
I was able to generate 1024x1024 with same card and --lowvram.

7 replies

Rizzlord Jul 27, 2023
Author

which setting and Arguments did u use? i ran out of memory with lowvram.

lshqqytiger Jul 27, 2023
Maintainer

--lowvram --backend directml
Terminate EVERYTHING which comsumes system resources. (kill explorer.exe and turn off monitors)
Sub-quadratic attention. (in Settings)
Negative Guidance minimum sigma 1.5
Token merging ratio 0.5
sd_xl_base_1.0.safetensors
1024x1024, Euler, 20 steps, CFG scale 7
prompt: a castle, masterpiece
negative prompt: worst quality
03:54<00:00, 11.75s/it

songib Jul 27, 2023

ok ill try --backend directml

songib Jul 27, 2023

@lshqqytiger
Using this set COMMANDLINE_ARGS= --backend directml --no-half --no-half-vae --precision full --always-batch-cond-uncond --medvram --api --autolaunch --theme dark --use-cpu CLIP BLIP interrogate
and it didn't work, is there any settings that I can tweak so I can use Adetailer again?

0%|                                                                                           | 0/20 [00:01<?, ?it/s]
*** Error completing request
*** Arguments: ('task(yzsm3lqoxm266qk)', 'Beautiful Girl, in a Garden,, Realism, Impressionism, masterful brushwork, dynamic use of light and shadow, rich color palette, expressive portraits, attention to detail, capturing the essence of his subjects, elegant and confident compositions,,', '', ['N. SnG New + General 1.3', 'N. Low Quality'], 20, 9, False, False, 4, 1, 6, 371199276.0, -1.0, 0, 0, 0, False, 768, 512, False, 0.35, 1.25, 'Latent', 0, 0, 0, 0, '', '', [], <gradio.routes.Request object at 0x00000293547FCE20>, 0, False, 'female', True, 1, True, -1.0, ['name', 'country', 'hair length', 'hair style', 'hair color'], [], [], [], True, {'ad_model': 'person_yolov8n-seg.pt', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'Merge and Invert', 'ad_mask_blur': 8, 'ad_denoising_strength': 0.35, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': True, 'ad_inpaint_width': 960, 'ad_inpaint_height': 960, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'person_yolov8n-seg.pt', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 8, 'ad_denoising_strength': 0.35, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': True, 'ad_inpaint_width': 960, 'ad_inpaint_height': 960, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'hand_yolov8n.pt', 'ad_prompt': '(Beautiful Perfect Hand, Detailed:1.3)', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 8, 'ad_denoising_strength': 0.35, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': True, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'face_yolov8n.pt', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 8, 'ad_denoising_strength': 0.35, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': True, 'ad_inpaint_width': 768, 'ad_inpaint_height': 768, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, False, False, 1, False, False, False, 1.1, 1.5, 100, 0.7, False, False, True, False, False, 0, 'Gustavosta/MagicPrompt-Stable-Diffusion', '', False, False, 'positive', 'comma', 0, False, False, '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0) {}
  Traceback (most recent call last):
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\call_queue.py", line 58, in f
      res = list(func(*args, **kwargs))
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\call_queue.py", line 37, in f
      res = func(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\txt2img.py", line 69, in txt2img
      processed = processing.process_images(p)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\processing.py", line 676, in process_images
      res = process_images_inner(p)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\processing.py", line 796, in process_images_inner
      samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\processing.py", line 1046, in sample
      samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_samplers_kdiffusion.py", line 464, in sample
      samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args={
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_samplers_kdiffusion.py", line 303, in launch_sampling
      return func()
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_samplers_kdiffusion.py", line 464, in <lambda>
      samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args={
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
      return func(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\k-diffusion\k_diffusion\sampling.py", line 594, in sample_dpmpp_2m
      denoised = model(x, sigmas[i] * s_in, **extra_args)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_samplers_kdiffusion.py", line 202, in forward
      x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b]))
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\k-diffusion\k_diffusion\external.py", line 112, in forward
      eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\k-diffusion\k_diffusion\external.py", line 138, in get_eps
      return self.inner_model.apply_model(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_hijack_utils.py", line 17, in <lambda>
      setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_hijack_utils.py", line 28, in __call__
      return self.__orig_func(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 858, in apply_model
      x_recon = self.model(x_noisy, t, **cond)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1538, in _call_impl
      result = forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 1335, in forward
      out = self.diffusion_model(x, t, context=cc)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_unet.py", line 91, in UNetModel_forward
      return ldm.modules.diffusionmodules.openaimodel.copy_of_UNetModel_forward_for_webui(self, x, timesteps, context, *args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\openaimodel.py", line 797, in forward
      h = module(h, emb, context)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\openaimodel.py", line 84, in forward
      x = layer(x, context)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\attention.py", line 334, in forward
      x = block(x, context=context[i])
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\attention.py", line 269, in forward
      return checkpoint(self._forward, (x, context), self.parameters(), self.checkpoint)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\util.py", line 121, in checkpoint
      return CheckpointFunction.apply(func, len(inputs), *args)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\autograd\function.py", line 506, in apply
      return super().apply(*args, **kwargs)  # type: ignore[misc]
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\util.py", line 136, in forward
      output_tensors = ctx.run_function(*ctx.input_tensors)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\repositories\stable-diffusion-stability-ai\ldm\modules\attention.py", line 272, in _forward
      x = self.attn1(self.norm1(x), context=context if self.disable_self_attn else None) + x
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
      return forward_call(*args, **kwargs)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\modules\sd_hijack_optimizations.py", line 264, in split_cross_attention_forward
      s1 = einsum('b i d, b j d -> b i j', q[:, i:end], k)
    File "C:\Art Software\Stable Diffusion WebUI (AI ART)\stable-diffusion-webui-directml\venv\lib\site-packages\torch\functional.py", line 378, in einsum
      return _VF.einsum(equation, operands)  # type: ignore[attr-defined]
  RuntimeError: Could not allocate tensor with 150994944 bytes. There is not enough GPU video memory available!

Rizzlord Jul 27, 2023
Author

i just make images in 928x928... works for me, without backend directml, it uses it anyway.
took 3.20m

songib · 2023-07-27T12:54:43Z

songib
Jul 27, 2023

@lshqqytiger

Probably due to upstream updates. You can checkout older commits.

Is there possible fix in the future commits for this? or should I stick to specific branch so I can use Adetailer?

2 replies

lshqqytiger Jul 27, 2023
Maintainer

I can assume why Adetailer does not work by comparing commits if we find the commit which broke it.

songib Jul 27, 2023

Ok, thanks.

EygenCat · 2023-07-28T14:31:35Z

EygenCat
Jul 28, 2023

Images must be generated in a resolution of up to 768 on one side. Since some neural networks, as well as loRa files, break down and generate complete nonsense.

he algorithm goes like this: we create an image at 768x768 resolution, then we enable the "Hi res. fix" option. As for the Hi res. fix, I recommend using 4x-UltraSharp. We upscale it by 2x (resize: from 768x768 to 1536x1536). Then, in the "Extras" tab, we adjust it to the desired resolution.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

SDXL 5700XT #205

{{title}}

Replies: 3 comments 9 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

SDXL 5700XT #205

Rizzlord Jul 26, 2023

Replies: 3 comments · 9 replies

lshqqytiger Jul 27, 2023 Maintainer

Rizzlord Jul 27, 2023 Author

lshqqytiger Jul 27, 2023 Maintainer

songib Jul 27, 2023

songib Jul 27, 2023

Rizzlord Jul 27, 2023 Author

songib Jul 27, 2023

lshqqytiger Jul 27, 2023 Maintainer

songib Jul 27, 2023

EygenCat Jul 28, 2023

Rizzlord
Jul 26, 2023

Replies: 3 comments 9 replies

lshqqytiger
Jul 27, 2023
Maintainer

Rizzlord Jul 27, 2023
Author

lshqqytiger Jul 27, 2023
Maintainer

Rizzlord Jul 27, 2023
Author

songib
Jul 27, 2023

lshqqytiger Jul 27, 2023
Maintainer

EygenCat
Jul 28, 2023