Text Generation WebUI issue

[wluo1007]

openbmb/MiniCPM-2B-sft-bf16 on Text Generation WebUI issue on ubuntu22.04:

set up the webUI following similar steps as window described here: https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/webui_quickstart.md

when loading the model, error would show as below:

[sgwhat]

hi @wluo1007 , we have reproduced your issue. We will inform you once we make progress.

[sgwhat]

Hi @wluo1007 , you may set export BIGDL_IMPORT_IPEX=0 before launching the webui.

[wluo1007]

thanks for the quick response, after export BIGDL_IMPORT_IPEX=0, it worked.

[niceTeen84]

Hi @sgwhat I have a question, webUI default bind adress is 127.0.0.1 how to change it?

[sgwhat]

@niceTeen84 , python server.py --load-in-4bit --listen --listen-host 0.0.0.0 --listen-port 8080