text-generation-webui
text-generation-webui copied to clipboard
Published
20 hours ago •
oobabooga
oobabooga
TypeError: __init__() got an unexpected keyword argument 'ssl_keyfile_password'
Describe the bug
running this from command line: python server.py --model TheBloke_stable-vicuna-13B-HF --load-in-8bit
results in this error and i cannot seem to get around it: TypeError: init() got an unexpected keyword argument 'ssl_keyfile_password'
Is there an existing issue for this?
- [X] I have searched the existing issues
Reproduction
run this:
$ python server.py --model TheBloke_stable-vicuna-13B-HF --load-in-8bit
Screenshot
No response
Logs
$ python server.py --model TheBloke_stable-vicuna-13B-HF --load-in-8bit
Gradio HTTP request redirected to localhost :)
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('local/138-2-239-179'), PosixPath('@/tmp/.ICE-unix/2510,unix/138-2-239-179')}
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('0'), PosixPath('1')}
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('/org/gnome/Terminal/screen/9134e0cf_f85e_4fe1_b114_28e4d90fac6c')}
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('unix'), PosixPath('path=/run/user/1001/bus,guid=b9c5700e6c8daafb044cc1986451b51f')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
CUDA SETUP: CUDA path found: /usr/local/cuda/lib64/libcudart.so
CUDA_SETUP: Detected CUDA version 116
CUDA_SETUP: Loading binary /home/silvacarl/.local/lib/python3.8/site-packages/bitsandbytes/libbitsandbytes_cuda116.so...
Loading TheBloke_stable-vicuna-13B-HF...
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:13<00:00, 4.58s/it]
Loaded the model in 15.13 seconds.
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /home/silvacarl/Desktop/oobabooga_linux/text-generation-webui/server.py:927 in <module> │
│ │
│ 924 │ │ }) │
│ 925 │ │
│ 926 │ # Launch the web UI │
│ ❱ 927 │ create_interface() │
│ 928 │ while True: │
│ 929 │ │ time.sleep(0.5) │
│ 930 │ │ if shared.need_restart: │
│ │
│ /home/silvacarl/Desktop/oobabooga_linux/text-generation-webui/server.py:852 in create_interface │
│ │
│ 849 │ if shared.args.listen: │
│ 850 │ │ shared.gradio['interface'].launch(prevent_thread_lock=True, share=shared.args.sh │
│ 851 │ else: │
│ ❱ 852 │ │ shared.gradio['interface'].launch(prevent_thread_lock=True, share=shared.args.sh │
│ 853 │
│ 854 │
│ 855 if __name__ == "__main__": │
│ │
│ /home/silvacarl/.local/lib/python3.8/site-packages/gradio/blocks.py:1703 in launch │
│ │
│ 1700 │ │ │ │ │ "Rerunning server... use `close()` to stop if you need to change `la │
│ 1701 │ │ │ │ ) │
│ 1702 │ │ else: │
│ ❱ 1703 │ │ │ server_name, server_port, local_url, app, server = networking.start_server( │
│ 1704 │ │ │ │ self, │
│ 1705 │ │ │ │ server_name, │
│ 1706 │ │ │ │ server_port, │
│ │
│ /home/silvacarl/.local/lib/python3.8/site-packages/gradio/networking.py:149 in start_server │
│ │
│ 146 │ │
│ 147 │ if blocks.save_to is not None: # Used for selenium tests │
│ 148 │ │ blocks.save_to["port"] = port │
│ ❱ 149 │ config = uvicorn.Config( │
│ 150 │ │ app=app, │
│ 151 │ │ port=port, │
│ 152 │ │ host=host, │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
TypeError: __init__() got an unexpected keyword argument 'ssl_keyfile_password'
System Info
$ python server.py --model TheBloke_stable-vicuna-13B-HF --load-in-8bit
Gradio HTTP request redirected to localhost :)
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('local/138-2-239-179'), PosixPath('@/tmp/.ICE-unix/2510,unix/138-2-239-179')}
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('0'), PosixPath('1')}
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('/org/gnome/Terminal/screen/9134e0cf_f85e_4fe1_b114_28e4d90fac6c')}
WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('unix'), PosixPath('path=/run/user/1001/bus,guid=b9c5700e6c8daafb044cc1986451b51f')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
CUDA SETUP: CUDA path found: /usr/local/cuda/lib64/libcudart.so
CUDA_SETUP: Detected CUDA version 116
CUDA_SETUP: Loading binary /home/silvacarl/.local/lib/python3.8/site-packages/bitsandbytes/libbitsandbytes_cuda116.so...
Loading TheBloke_stable-vicuna-13B-HF...
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:13<00:00, 4.58s/it]
Loaded the model in 15.13 seconds.
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /home/silvacarl/Desktop/oobabooga_linux/text-generation-webui/server.py:927 in <module> │
│ │
│ 924 │ │ }) │
│ 925 │ │
│ 926 │ # Launch the web UI │
│ ❱ 927 │ create_interface() │
│ 928 │ while True: │
│ 929 │ │ time.sleep(0.5) │
│ 930 │ │ if shared.need_restart: │
│ │
│ /home/silvacarl/Desktop/oobabooga_linux/text-generation-webui/server.py:852 in create_interface │
│ │
│ 849 │ if shared.args.listen: │
│ 850 │ │ shared.gradio['interface'].launch(prevent_thread_lock=True, share=shared.args.sh │
│ 851 │ else: │
│ ❱ 852 │ │ shared.gradio['interface'].launch(prevent_thread_lock=True, share=shared.args.sh │
│ 853 │
│ 854 │
│ 855 if __name__ == "__main__": │
│ │
│ /home/silvacarl/.local/lib/python3.8/site-packages/gradio/blocks.py:1703 in launch │
│ │
│ 1700 │ │ │ │ │ "Rerunning server... use `close()` to stop if you need to change `la │
│ 1701 │ │ │ │ ) │
│ 1702 │ │ else: │
│ ❱ 1703 │ │ │ server_name, server_port, local_url, app, server = networking.start_server( │
│ 1704 │ │ │ │ self, │
│ 1705 │ │ │ │ server_name, │
│ 1706 │ │ │ │ server_port, │
│ │
│ /home/silvacarl/.local/lib/python3.8/site-packages/gradio/networking.py:149 in start_server │
│ │
│ 146 │ │
│ 147 │ if blocks.save_to is not None: # Used for selenium tests │
│ 148 │ │ blocks.save_to["port"] = port │
│ ❱ 149 │ config = uvicorn.Config( │
│ 150 │ │ app=app, │
│ 151 │ │ port=port, │
│ 152 │ │ host=host, │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
TypeError: __init__() got an unexpected keyword argument 'ssl_keyfile_password'
forgot one thing: this occurs on Ubuntu 20.04
It seems like there might be an issue with the Gradio library or an incompatibility between Gradio and another library in your project. The error message indicates that __init__() function of the Uvicorn Config object received an unexpected keyword argument ssl_keyfile_password.
Try the following:
- Ensure that you have the latest version of the Gradio library installed. You can update the Gradio library by running:
pip install -U gradio
-
If you are using a custom SSL setup for your project, double-check your implementation and the arguments passed to the Gradio and Uvicorn configurations.
-
If updating Gradio doesn't resolve the issue, you can consider opening a new issue on the Gradio GitHub repository (https://github.com/gradio-app/gradio) and provide the information you've shared here. The Gradio maintainers may be able to help you diagnose and resolve the issue.
Please make sure to include the error message, traceback, and system information in the issue, so the maintainers can better understand the problem.
This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}