V2.3 Blank responses from any model #6708

Malumen · 2025-01-28T07:10:20Z

Describe the bug

GPU is GTX 1070 8GB VRAM

I had an assistant working, SSD failed and I lost everything.

Reinstalling a new SSD, and installing the webui and model, I get blank responses from the AI. Chat, instruct, anything, tried several different models. IIRC I had been using CUDA 11.8, tried 12.1 as well, no dice.

Here is me using the absolute basic model that should work.

Is there an existing issue for this?

I have searched the existing issues

Reproduction

Basic install, either CUDA, choose a model, reboot and apply, responses are blank, null tokens generated

Screenshot

Logs

*******************************************************************
* You haven't downloaded any model yet.
* Once the web UI launches, head over to the "Model" tab and download one.
*******************************************************************


15:56:39-595807 INFO     Starting Text generation web UI

Running on local URL:  http://127.0.0.1:7860

15:58:19-713841 INFO     Loading "TheBloke_WizardLM-7B-V1.0-Uncensored-GPTQ"
 ## Warning: Flash Attention is installed but unsupported GPUs were detected.
15:58:29-605036 INFO     Loaded "TheBloke_WizardLM-7B-V1.0-Uncensored-GPTQ" in 9.89 seconds.
15:58:29-620688 INFO     LOADER: "ExLlamav2"
15:58:29-620688 INFO     TRUNCATION LENGTH: 2048
15:58:29-620688 INFO     INSTRUCTION TEMPLATE: "Vicuna-v1.1"
15:58:34-428491 INFO     Loading "TheBloke_WizardLM-7B-V1.0-Uncensored-GPTQ"
15:58:39-326765 INFO     Loaded "TheBloke_WizardLM-7B-V1.0-Uncensored-GPTQ" in 4.90 seconds.
15:58:39-326765 INFO     LOADER: "ExLlamav2"
15:58:39-342379 INFO     TRUNCATION LENGTH: 2048
15:58:39-342379 INFO     INSTRUCTION TEMPLATE: "Vicuna-v1.1"
Traceback (most recent call last):
  File "D:\LocalAized\modules\text_generation.py", line 479, in generate_reply_custom
    for reply in shared.model.generate_with_streaming(question, state):
  File "D:\LocalAized\modules\exllamav2.py", line 182, in generate_with_streaming
    self.generator.begin_stream(ids, settings, loras=self.loras)
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 230, in begin_stream
    self.begin_stream_ex(input_ids,
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 363, in begin_stream_ex
    self._gen_begin_reuse(input_ids, gen_settings)
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 731, in _gen_begin_reuse
    self._gen_begin(in_tokens, gen_settings)
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 692, in _gen_begin
    self.model.forward(self.sequence_ids[:, :-1],
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\model.py", line 900, in forward
    r = self.forward_chunk(
        ^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\model.py", line 1012, in forward_chunk
    x = module.forward(x, cache = cache, attn_params = attn_params, past_len = past_len, loras = loras, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\attn.py", line 1145, in forward
    attn_output = attn_func(batch_size, q_len, q_states, k_states, v_states, attn_params, cfg)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\attn.py", line 942, in _attn_flash    attn_output = flash_attn_func(
                  ^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\flash_attn\flash_attn_interface.py", line 1201, in flash_attn_func
    return FlashAttnFunc.apply(
           ^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\autograd\function.py", line 574, in apply
    return super().apply(*args, **kwargs)  # type: ignore[misc]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\flash_attn\flash_attn_interface.py", line 839, in forward
    out_padded, softmax_lse, S_dmask, rng_state = _wrapped_flash_attn_forward(
                                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\_ops.py", line 1061, in __call__
    return self_._op(*args, **(kwargs or {}))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\_library\custom_ops.py", line 236, in backend_impl
    result = self._backend_fns[device_type](*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\flash_attn\flash_attn_interface.py", line 96, in _flash_attn_forward
    out, softmax_lse, S_dmask, rng_state = flash_attn_gpu.fwd(
                                           ^^^^^^^^^^^^^^^^^^^
RuntimeError: FlashAttention only supports Ampere GPUs or newer.
Exception raised from mha_fwd at D:\a\flash-attention\flash-attention\csrc\flash_attn\flash_api.cpp:368 (most recent call first):
00007FFF1AFB462900007FFF1AFB4580 c10.dll!c10::Error::Error [<unknown file> @ <unknown line number>]
00007FFF1AFB416A00007FFF1AFB4110 c10.dll!c10::detail::torchCheckFail [<unknown file> @ <unknown line number>]
00007FFD3F6E39C300007FFD3F6D5CA0 flash_attn_2_cuda.cp311-win_amd64.pyd!c10::ivalue::Object::operator= [<unknown file> @ <unknown line number>]
00007FFD3F6F5BD600007FFD3F6EC910 flash_attn_2_cuda.cp311-win_amd64.pyd!PyInit_flash_attn_2_cuda [<unknown file> @ <unknown line number>]
00007FFD3F6F5CE400007FFD3F6EC910 flash_attn_2_cuda.cp311-win_amd64.pyd!PyInit_flash_attn_2_cuda [<unknown file> @ <unknown line number>]
00007FFD3F6DECDF00007FFD3F6D5CA0 flash_attn_2_cuda.cp311-win_amd64.pyd!c10::ivalue::Object::operator= [<unknown file> @ <unknown line number>]
00007FFEF6A8BCFC00007FFEF6A8AFC0 python311.dll!PyCFunction_GetFlags [<unknown file> @ <unknown line number>]
00007FFEF6A4500100007FFEF6A44EE0 python311.dll!PyObject_MakeTpCall [<unknown file> @ <unknown line number>]
00007FFEF6A4526100007FFEF6A45240 python311.dll!PyObject_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6B6EDE400007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A451CD00007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7468D00007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A451CD00007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFED53ED77A00007FFED53C71F0 torch_python.dll!torch::PythonArgParser::raw_parse [<unknown file> @ <unknown line number>]
00007FFD773F88CC00007FFD773F8760 torch_cpu.dll!c10::Dispatcher::callBoxed [<unknown file> @ <unknown line number>]
00007FFED51CF45F00007FFED51CF390 torch_python.dll!torch::jit::invokeOperatorFromPython [<unknown file> @ <unknown line number>]
00007FFED51CC39F00007FFED51CC220 torch_python.dll!torch::jit::_get_operation_for_overload_or_packet [<unknown file> @ <unknown line number>]
00007FFED50DD71800007FFED505BB00 torch_python.dll!registerPythonTensorClass [<unknown file> @ <unknown line number>]
00007FFED51377B000007FFED505BB00 torch_python.dll!registerPythonTensorClass [<unknown file> @ <unknown line number>]
00007FFED50D6BF600007FFED505BB00 torch_python.dll!registerPythonTensorClass [<unknown file> @ <unknown line number>]
00007FFED4BAF56B00007FFED4BADFF0 torch_python.dll!c10::ivalue::Future::devices [<unknown file> @ <unknown line number>]
00007FFEF6A8BCFC00007FFEF6A8AFC0 python311.dll!PyCFunction_GetFlags [<unknown file> @ <unknown line number>]
00007FFEF6A4534E00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7475400007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A44E0100007FFEF6A44D50 python311.dll!PyObject_FastCallDictTstate [<unknown file> @ <unknown line number>]
00007FFEF6A4571200007FFEF6A45670 python311.dll!PyObject_Call_Prepend [<unknown file> @ <unknown line number>]
00007FFEF6AB2FB300007FFEF6AAF5A0 python311.dll!PyType_Ready [<unknown file> @ <unknown line number>]
00007FFEF6A4500100007FFEF6A44EE0 python311.dll!PyObject_MakeTpCall [<unknown file> @ <unknown line number>]
00007FFEF6A4526100007FFEF6A45240 python311.dll!PyObject_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6B6EDE400007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A451CD00007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFED503134100007FFED501DE40 torch_python.dll!THPPointer<_frame>::THPPointer<_frame> [<unknown file> @ <unknown line number>]
00007FFEF6A8BD3700007FFEF6A8AFC0 python311.dll!PyCFunction_GetFlags [<unknown file> @ <unknown line number>]
00007FFEF6A4534E00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7475400007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A4510900007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7468D00007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A4778100007FFEF6A473C0 python311.dll!PyCell_Set [<unknown file> @ <unknown line number>]
00007FFEF6A47CAD00007FFEF6A47BF0 python311.dll!PyMethod_Self [<unknown file> @ <unknown line number>]
00007FFEF6A4510900007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7468D00007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]

Output generated in 0.99 seconds (0.00 tokens/s, 0 tokens, context 129, seed 2084079514)
Traceback (most recent call last):
  File "D:\LocalAized\modules\text_generation.py", line 479, in generate_reply_custom
    for reply in shared.model.generate_with_streaming(question, state):
  File "D:\LocalAized\modules\exllamav2.py", line 182, in generate_with_streaming
    self.generator.begin_stream(ids, settings, loras=self.loras)
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 230, in begin_stream
    self.begin_stream_ex(input_ids,
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 363, in begin_stream_ex
    self._gen_begin_reuse(input_ids, gen_settings)
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 731, in _gen_begin_reuse
    self._gen_begin(in_tokens, gen_settings)
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\generator\streaming.py", line 692, in _gen_begin
    self.model.forward(self.sequence_ids[:, :-1],
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\model.py", line 900, in forward
    r = self.forward_chunk(
        ^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\model.py", line 1012, in forward_chunk
    x = module.forward(x, cache = cache, attn_params = attn_params, past_len = past_len, loras = loras, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\attn.py", line 1145, in forward
    attn_output = attn_func(batch_size, q_len, q_states, k_states, v_states, attn_params, cfg)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\exllamav2\attn.py", line 942, in _attn_flash    attn_output = flash_attn_func(
                  ^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\flash_attn\flash_attn_interface.py", line 1201, in flash_attn_func
    return FlashAttnFunc.apply(
           ^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\autograd\function.py", line 574, in apply
    return super().apply(*args, **kwargs)  # type: ignore[misc]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\flash_attn\flash_attn_interface.py", line 839, in forward
    out_padded, softmax_lse, S_dmask, rng_state = _wrapped_flash_attn_forward(
                                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\_ops.py", line 1061, in __call__
    return self_._op(*args, **(kwargs or {}))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\torch\_library\custom_ops.py", line 236, in backend_impl
    result = self._backend_fns[device_type](*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\LocalAized\installer_files\env\Lib\site-packages\flash_attn\flash_attn_interface.py", line 96, in _flash_attn_forward
    out, softmax_lse, S_dmask, rng_state = flash_attn_gpu.fwd(
                                           ^^^^^^^^^^^^^^^^^^^
RuntimeError: FlashAttention only supports Ampere GPUs or newer.
Exception raised from mha_fwd at D:\a\flash-attention\flash-attention\csrc\flash_attn\flash_api.cpp:368 (most recent call first):
00007FFF1AFB462900007FFF1AFB4580 c10.dll!c10::Error::Error [<unknown file> @ <unknown line number>]
00007FFF1AFB416A00007FFF1AFB4110 c10.dll!c10::detail::torchCheckFail [<unknown file> @ <unknown line number>]
00007FFD3F6E39C300007FFD3F6D5CA0 flash_attn_2_cuda.cp311-win_amd64.pyd!c10::ivalue::Object::operator= [<unknown file> @ <unknown line number>]
00007FFD3F6F5BD600007FFD3F6EC910 flash_attn_2_cuda.cp311-win_amd64.pyd!PyInit_flash_attn_2_cuda [<unknown file> @ <unknown line number>]
00007FFD3F6F5CE400007FFD3F6EC910 flash_attn_2_cuda.cp311-win_amd64.pyd!PyInit_flash_attn_2_cuda [<unknown file> @ <unknown line number>]
00007FFD3F6DECDF00007FFD3F6D5CA0 flash_attn_2_cuda.cp311-win_amd64.pyd!c10::ivalue::Object::operator= [<unknown file> @ <unknown line number>]
00007FFEF6A8BCFC00007FFEF6A8AFC0 python311.dll!PyCFunction_GetFlags [<unknown file> @ <unknown line number>]
00007FFEF6A4500100007FFEF6A44EE0 python311.dll!PyObject_MakeTpCall [<unknown file> @ <unknown line number>]
00007FFEF6A4526100007FFEF6A45240 python311.dll!PyObject_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6B6EDE400007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A451CD00007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7468D00007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A451CD00007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFED53ED77A00007FFED53C71F0 torch_python.dll!torch::PythonArgParser::raw_parse [<unknown file> @ <unknown line number>]
00007FFD773F88CC00007FFD773F8760 torch_cpu.dll!c10::Dispatcher::callBoxed [<unknown file> @ <unknown line number>]
00007FFED51CF45F00007FFED51CF390 torch_python.dll!torch::jit::invokeOperatorFromPython [<unknown file> @ <unknown line number>]
00007FFED51CC39F00007FFED51CC220 torch_python.dll!torch::jit::_get_operation_for_overload_or_packet [<unknown file> @ <unknown line number>]
00007FFED50DD71800007FFED505BB00 torch_python.dll!registerPythonTensorClass [<unknown file> @ <unknown line number>]
00007FFED51377B000007FFED505BB00 torch_python.dll!registerPythonTensorClass [<unknown file> @ <unknown line number>]
00007FFED50D6BF600007FFED505BB00 torch_python.dll!registerPythonTensorClass [<unknown file> @ <unknown line number>]
00007FFED4BAF56B00007FFED4BADFF0 torch_python.dll!c10::ivalue::Future::devices [<unknown file> @ <unknown line number>]
00007FFEF6A8BCFC00007FFEF6A8AFC0 python311.dll!PyCFunction_GetFlags [<unknown file> @ <unknown line number>]
00007FFEF6A4534E00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7475400007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A44E0100007FFEF6A44D50 python311.dll!PyObject_FastCallDictTstate [<unknown file> @ <unknown line number>]
00007FFEF6A4571200007FFEF6A45670 python311.dll!PyObject_Call_Prepend [<unknown file> @ <unknown line number>]
00007FFEF6AB2FB300007FFEF6AAF5A0 python311.dll!PyType_Ready [<unknown file> @ <unknown line number>]
00007FFEF6A4500100007FFEF6A44EE0 python311.dll!PyObject_MakeTpCall [<unknown file> @ <unknown line number>]
00007FFEF6A4526100007FFEF6A45240 python311.dll!PyObject_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6B6EDE400007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A451CD00007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFED503134100007FFED501DE40 torch_python.dll!THPPointer<_frame>::THPPointer<_frame> [<unknown file> @ <unknown line number>]
00007FFEF6A8BD3700007FFEF6A8AFC0 python311.dll!PyCFunction_GetFlags [<unknown file> @ <unknown line number>]
00007FFEF6A4534E00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7475400007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A4510900007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7468D00007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6A4548D00007FFEF6A45450 python311.dll!PyFunction_Vectorcall [<unknown file> @ <unknown line number>]
00007FFEF6A4778100007FFEF6A473C0 python311.dll!PyCell_Set [<unknown file> @ <unknown line number>]
00007FFEF6A47CAD00007FFEF6A47BF0 python311.dll!PyMethod_Self [<unknown file> @ <unknown line number>]
00007FFEF6A4510900007FFEF6A45050 python311.dll!PyVectorcall_Function [<unknown file> @ <unknown line number>]
00007FFEF6A452EF00007FFEF6A452A0 python311.dll!PyObject_Call [<unknown file> @ <unknown line number>]
00007FFEF6B7468D00007FFEF6B74200 python311.dll!PyEval_GetFuncDesc [<unknown file> @ <unknown line number>]
00007FFEF6B6FE7300007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]
00007FFEF6B72B8E00007FFEF6B6AA00 python311.dll!PyEval_EvalFrameDefault [<unknown file> @ <unknown line number>]

Output generated in 0.02 seconds (0.00 tokens/s, 0 tokens, context 137, seed 1769324838)

System Info

CPU: Intel 8750H
GPU: nVidia GTX 1070 8GB
RAM: 32GB @ 3200MHz

zipsplat · 2025-02-06T17:42:03Z

What is the message when you load the model to verify it loaded correctly?

Malumen added the bug Something isn't working label Jan 28, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

V2.3 Blank responses from any model #6708

V2.3 Blank responses from any model #6708

Malumen commented Jan 28, 2025 •

edited

Loading

zipsplat commented Feb 6, 2025

V2.3 Blank responses from any model #6708

V2.3 Blank responses from any model #6708

Comments

Malumen commented Jan 28, 2025 • edited Loading

Describe the bug

Is there an existing issue for this?

Reproduction

Screenshot

Logs

System Info

zipsplat commented Feb 6, 2025

Malumen commented Jan 28, 2025 •

edited

Loading