text-generation-webui
text-generation-webui copied to clipboard
AutoAWQ gone missing (model loader) and charecter not loading (for my case, out of 5 charecters, only 2 of them are loading)
Describe the bug
When I start the program, it went blank screen (like, noting except for the UI elements). So, when I was trying to select the character from the dropdown menu, it was not selecting the characters, barring the two. Then I tried to edit the characters in "Parameters" option, but there also, character cannot be selected. I checked in the folder directly and found, characters are already there but for some reason, it is not getting selected.
And as for the second bug/problem, the AutoAWQ loader is missing.
Is there an existing issue for this?
- [X] I have searched the existing issues
Reproduction
- Start the program
- Let it load
- Bug/problem
Screenshot
This is the screenshot of the missing AutoAWQ loader.
Logs
Traceback (most recent call last):
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\queueing.py", line 527, in process_events
response = await route_utils.call_process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\route_utils.py", line 261, in call_process_api
output = await app.get_blocks().process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1786, in process_api
result = await self.call_function(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1338, in call_function
prediction = await anyio.to_thread.run_sync(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 2134, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\utils.py", line 759, in wrapper
response = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\chat.py", line 1131, in handle_character_menu_change
html = redraw_html(history, state['name1'], state['name2'], state['mode'], state['chat_style'], state['character_menu'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\chat.py", line 483, in redraw_html
return chat_html_wrapper(history, name1, name2, mode, style, character, reset_cache=reset_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 303, in chat_html_wrapper
return generate_cai_chat_html(history['visible'], name1, name2, style, character, reset_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 227, in generate_cai_chat_html
row = [convert_to_markdown_wrapped(entry, use_cache=i != len(history) - 1) for entry in _row]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 227, in <listcomp>
row = [convert_to_markdown_wrapped(entry, use_cache=i != len(history) - 1) for entry in _row]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 149, in convert_to_markdown_wrapped
return convert_to_markdown.__wrapped__(string)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 76, in convert_to_markdown
string = replace_quotes(string)
^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\html_generator.py", line 63, in replace_quotes
replaced_text = re.sub(pattern, lambda m: f'<q>{m.group(1)}{m.group(2)}{m.group(3)}</q>', text, flags=re.DOTALL)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\re\__init__.py", line 185, in sub
return _compile(pattern, flags).sub(repl, string, count)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: expected string or bytes-like object, got 'NoneType'
---------------------------------------------------------------------------------------------------------
Traceback (most recent call last):
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\queueing.py", line 527, in process_events
response = await route_utils.call_process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\route_utils.py", line 261, in call_process_api
output = await app.get_blocks().process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1786, in process_api
result = await self.call_function(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\blocks.py", line 1338, in call_function
prediction = await anyio.to_thread.run_sync(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 2134, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\anyio\_backends\_asyncio.py", line 851, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\installer_files\env\Lib\site-packages\gradio\utils.py", line 759, in wrapper
response = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "D:\StableDiffution\text-generation-webui\modules\loaders.py", line 351, in blacklist_samplers
if loader == 'All' or sampler in loaders_samplers[loader]:
~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'AutoAWQ'
System Info
ASUS ROG STRIX Laptop.
CPU: Intel i7 10875H
GPU: NVIDIA RTX 2080 Super
Settings (extensions used) in textgen:
"gallery"
"send_pictures"
"autonomics"
"alltalk_tts" (with deepspeed and low vram)
"LLM_Web_search"
"Memoir"