Results 25 comments of tsantra

@AntalZsiros did it fix your issue?

[log.txt](https://github.com/intel-analytics/ipex-llm/files/14764590/log.txt) @yangw1234 attaching the log file which has the output of the env-check.sh script. It says IPEX is not installed. I have followed the following installation steps:

I am facing the same issue. I used " # Force final answer if necessary cb.answer_reached = True" and now answer is repeated. And I am using Sync callback @cl.on_message...

@rnwang04 Thank you. It worked after installing accelerate=0.23.0 I have two questions: 1. Is QLora fine-tuning supported on CPU? 2. The code here https://github.com/intel-analytics/BigDL/blob/main/python/llm/example/GPU/QLoRA-FineTuning/export_merged_model.py , shows device_map={"": cpu}, so which...

Hi @rnwang04 , thank you for your reply! Are you using any metric to check for model accuracy after QLora finetuning. I had used my custom dataset for finetuning and...

@rnwang04 GPU finetuning suddenly stopped working and gave Seg Fault.