WeiguangHan comments

Results 5 comments of


                                            WeiguangHan

inference problem with baichuan 13b

> > > > Could you provide more details? > > > > > > > > * Are you running baichuan1 or baichuan2? > > > > * What...

LLM: use pip to install bigdl-llm

> ![image](https://private-user-images.githubusercontent.com/54161268/298516261-90778740-0b42-426d-9196-33d4306a5389.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU5MTMxNTMsIm5iZiI6MTcwNTkxMjg1MywicGF0aCI6Ii81NDE2MTI2OC8yOTg1MTYyNjEtOTA3Nzg3NDAtMGI0Mi00MjZkLTkxOTYtMzNkNDMwNmE1Mzg5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAxMjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMTIyVDA4NDA1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTk0M2E4ODQzYmY4NDA5OWU2OTI5N2YyYWI3NDIwNDJkYTA0MTJmYmM4NjJhZDFjMzgyMDFmMzliYWQ2ZWZlZTgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.JR11FgAJQ0luBYf5OrAT3o8RJSu6tjfemEdrgFaHl4A) These lines are also needed to be commented out Sure. Have commented them.

如何让TTS生成女性声音

> 开发者你好，感谢关注 PaddleSpeech 开源项目，抱歉给你带来了不好的开发体验，目前开源项目维护人力有限，建议参考：#1620 多谢！在成功更换音色之后，我会关掉这个issue

Inference speed and memory usage of Qwen1.5-14b

> Hi @WeiguangHan , we can not reproduce the issue on an Ultra 5 125H CPU. > > The CPU usage when running qwen1.5 example script turned out pretty normal:...

LLM: add more info for env check script

Sample output on Arc-11: ``` ----------------------------------------------------------------- PYTHON_VERSION=3.9.18 ----------------------------------------------------------------- transformers=4.31.0 ----------------------------------------------------------------- torch=2.1.0a0+cxx11.abi ----------------------------------------------------------------- BigDL Version: 2.5.0b20240317 ----------------------------------------------------------------- /home/arda/anaconda3/envs/weiguang-llm-test/lib/python3.9/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: ''If you don't plan on using...