Wang, Jian4

> Is there an implementation from HuggingFace for QWen instead? It seems that Chinese model such as baichuan and qwen are not supported by HuggingFace API.

> What pytorch version are you using? Have you tried pytorch mainline? I run this bash to install related libs: `bash ./tools/env_setup.sh `. The pytorch version is controlled by the...

> Thanks. I guess that's the problem we should fix from the mainline. cc @jingxu10 > > On the other hand, we usually recommend users to use a more stable...

> Perhaps, you can try to hack the following line to work around the problem. I haven't tried locally though. I try it and don't meet the error again. But...

@YUO4YUM I try to use 17000 tokens to inference but I can't reproduce this issue. Maybe you need to follow [this guide](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/bigdl_llm_migration.html) to upgrade bigdl-llm to ipex-llm and use the...

@YUO4YUM I meet this error too when running `chatglm3-6b-32k`. And we will fix it by [this pr](https://github.com/intel-analytics/ipex-llm/pull/10719).

@YUO4YUM We have fixed this issue, and you could use the latest ipex-llm version to test.

Maybe you don't set `JUPYTER_RUNTIME_DIR` and `JUPYTER_DATA_DIR`, and the 'usr/local/' should be `/usr/local`. I try this command and successfully start jupyter service locally. ```bash cd /ppml export JUPYTER_RUNTIME_DIR=/ppml/jupyter/runtime export JUPYTER_DATA_DIR=/ppml/jupyter/data...

> @hzjane hi, I have some questions about running Jupyter inside SGX, Q1: Did your solution patch Jupyter Lab's source code , or just directly run it in the TEE...

> > Maybe you don't set `JUPYTER_RUNTIME_DIR` and `JUPYTER_DATA_DIR`, and the 'usr/local/' should be `/usr/local`. I try this command and successfully start jupyter service locally. > > ```shell > >...