Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Prompt Editing Crashes Images Generation #16039

Open
4 of 6 tasks
don1138 opened this issue Jun 18, 2024 · 0 comments
Open
4 of 6 tasks

[Bug]: Prompt Editing Crashes Images Generation #16039

don1138 opened this issue Jun 18, 2024 · 0 comments
Labels
bug-report Report of a bug, yet to be confirmed

Comments

@don1138
Copy link

don1138 commented Jun 18, 2024

Checklist

  • The issue exists after disabling all extensions
  • The issue exists on a clean installation of webui
  • The issue is caused by an extension, but I believe it is caused by a bug in the webui
  • The issue exists in the current version of the webui
  • The issue has not been reported before recently
  • The issue has been reported before but has not been fixed yet

What happened?

When using Prompt editing with a when values, the generation errors out.

For example, [cat:dog:0.5] crashes, as does [cat:dog:5].

[cat:dog] generates an image of two cats.

( Perhaps unrelated, but alternating words [cat|dog] works correctly. )

Steps to reproduce the problem

  1. Launch WebUI
  2. Add prompt [cat:dog:0.5]
  3. Press Generate button

Generation fails with error message

What should have happened?

WebUI should use the prompt cat for the first half of the steps, then dog for the last half of the steps, and produce an image.

What browsers do you use to access the UI ?

Mozilla Firefox, Google Chrome, Other

Sysinfo

sysinfo-2024-06-18-01-57.json

Console logs

User1@MyMac ~ % cd /Users/User1/stable-diffusion-webui;./webui.sh       

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer.
################################################################

################################################################
Running on User1 user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Python 3.10.14 (main, Mar 19 2024, 21:46:16) [Clang 15.0.0 (clang-1500.1.0.2.5)]
Version: v1.9.4
Commit hash: feee37d75f1b168768014e4634dcb156ee649c05

Launching Web UI with arguments: --skip-torch-cuda-test --upcast-sampling --opt-sub-quad-attention --use-cpu interrogate --no-half-vae --medvram-sdxl --disable-safe-unpickle --api

no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.

Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
OMP: Info #276: omp_set_nested routine deprecated, please use omp_set_max_active_levels instead.
[sdwi2iextender] Developper warning:
[sdwi2iextender] ./modules/img2img.py is being recompiled at run time with a patch. Your debugger will not work in this file.
[sdwi2iextender] If you need debug tools in this file, disable all extensions that use the sdwi2iextender library.
[sdwi2iextender] This patch is temporary and will be removed when v1.9 will be released.
Loading weights [6af0bd7153] from /Users/User1/stable-diffusion-webui/models/Stable-diffusion/anime/Break Domain/BreakDomain Realistic R2462/BreakDomain Realistic R2462.safetensors
Creating model from config: /Users/User1/stable-diffusion-webui/configs/v1-inference.yaml
/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.

Startup time                           : 4.8s (
  prepare environment                  : 0.2s, 
  import torch                         : 1.7s, 
  import gradio                        : 0.4s, 
  setup paths                          : 0.6s, 
  initialize shared                    : 0.1s, 
  other imports                        : 0.4s, 
  load scripts                         : 0.6s, 
  create ui                            : 0.3s, 
  add APIs                             : 0.2s).

Loading VAE weights specified in settings: /Users/User1/stable-diffusion-webui/models/VAE/KL F8 Anime/KL F8 Anime2 fp16.pt
Applying attention optimization: sub-quadratic... done.

Model loaded in                        : 2.2s (
  create model                         : 0.5s, 
  apply weights to model               : 0.5s, 
  load VAE                             : 0.1s, 
  move model to device                 : 0.1s, 
  load textual inversion embeddings    : 0.7s, 
  calculate empty prompt               : 0.2s).

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 244, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)  # type: ignore[func-returns-value]
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__
    return await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/fastapi/applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/base.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/base.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/cors.py", line 76, in __call__
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
    raise exc
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 21, in __call__
    raise e
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/starlette/routing.py", line 82, in app
    await func(session)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/fastapi/routing.py", line 289, in app
    await dependant.call(**values)
  File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/gradio/routes.py", line 619, in join_queue
    if blocks.dependencies[event.fn_index].get("every", 0):
IndexError: list index out of range
*** Error completing request
*** Arguments: ('task(e742yx7z5d9z7rt)', <gradio.routes.Request object at 0x2a1220a90>, '[cat:dog:0.5]', '', [], 1, 1, 7, 512, 512, False, 0.382, 2, '4x_NMKD_Siax_200k', 10, 0, 0, 'Use same checkpoint', 'Use same sampler', 'Use same scheduler', '', '', [], 0, 20, 'DPM++ 2M', 'Karras', False, '', 0.8, 0, False, -1, 0, 0, 0, False, False, False, 0.0, 4, 0.0, 512, 512, True, 'None', 'None', 0, False, False, 'positive', 'comma', 0, False, False, 'start', '', 0, '', [], 0, '', [], 0, '', [], True, False, False, False, False, False, False, 0, False) {}
    Traceback (most recent call last):
      File "/Users/User1/stable-diffusion-webui/modules/call_queue.py", line 57, in f
        res = list(func(*args, **kwargs))
      File "/Users/User1/stable-diffusion-webui/modules/call_queue.py", line 36, in f
        res = func(*args, **kwargs)
      File "/Users/User1/stable-diffusion-webui/modules/txt2img.py", line 109, in txt2img
        processed = processing.process_images(p)
      File "/Users/User1/stable-diffusion-webui/modules/processing.py", line 845, in process_images
        res = process_images_inner(p)
      File "/Users/User1/stable-diffusion-webui/modules/processing.py", line 959, in process_images_inner
        p.setup_conds()
      File "/Users/User1/stable-diffusion-webui/modules/processing.py", line 1495, in setup_conds
        super().setup_conds()
      File "/Users/User1/stable-diffusion-webui/modules/processing.py", line 507, in setup_conds
        self.c = self.get_conds_with_caching(prompt_parser.get_multicond_learned_conditioning, prompts, total_steps, [self.cached_c], self.extra_network_data)
      File "/Users/User1/stable-diffusion-webui/modules/processing.py", line 492, in get_conds_with_caching
        cache[1] = function(shared.sd_model, required_prompts, steps, hires_steps, shared.opts.use_old_scheduling)
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 261, in get_multicond_learned_conditioning
        learned_conditioning = get_learned_conditioning(model, prompt_flat_list, steps, hires_steps, use_old_scheduling)
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 177, in get_learned_conditioning
        prompt_schedules = get_learned_conditioning_prompt_schedules(prompts, steps, hires_steps, use_old_scheduling)
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 132, in get_learned_conditioning_prompt_schedules
        promptdict = {prompt: get_schedule(prompt) for prompt in set(prompts)}
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 132, in <dictcomp>
        promptdict = {prompt: get_schedule(prompt) for prompt in set(prompts)}
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 130, in get_schedule
        return [[t, at_step(t, tree)] for t in collect_steps(steps, tree)]
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 96, in collect_steps
        CollectSteps().visit(tree)
      File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/lark/visitors.py", line 316, in visit
        self._call_userfunc(subtree)
      File "/Users/User1/stable-diffusion-webui/venv/lib/python3.10/site-packages/lark/visitors.py", line 294, in _call_userfunc
        return getattr(self, tree.data, self.__default__)(tree)
      File "/Users/User1/stable-diffusion-webui/modules/prompt_parser.py", line 81, in scheduled
        v = float(s)
    TypeError: float() argument must be a string or a real number, not 'Tree'

---

Additional information

No response

@don1138 don1138 added the bug-report Report of a bug, yet to be confirmed label Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-report Report of a bug, yet to be confirmed
Projects
None yet
Development

No branches or pull requests

1 participant