web_demo doesn't work

[DanielProkhorov]

I tried to run the gradio demo as follows:

python web_demo.py --from_pretrained cogcom-base-17b --local_tokenizer lmsys/vicuna-7b-v1.5 --bf16

resulting in this error:

drawn_imgs = gr.Gallery(
                 ^^^^^^^^^^^

TypeError: Gallery.__init__() got an unexpected keyword argument 'width'

[qijimrc]

I tried to run the gradio demo as follows:

python web_demo.py --from_pretrained cogcom-base-17b --local_tokenizer lmsys/vicuna-7b-v1.5 --bf16

resulting in this error:

drawn_imgs = gr.Gallery(
                 ^^^^^^^^^^^

TypeError: Gallery.__init__() got an unexpected keyword argument 'width'

Hi, for a smooth training and inference, we need to keep a proper version of the pydantic package, and which will influence the versions of gradio, and spacy. I have updated the requirements.txt including these versions, and we will relax this constraints soon.

[terryII]

hi,我尝试在4090上运行web demo,出现cuda out of memory,如何采用多卡来进行web demo的部署？ @qijimrc