Puyuan Liu

I guess you have to ``` CUDA_VERSION=118 make cuda11x python setup.py install ```

Got the same problem, I installed openmpi==4.0.2 from anaconda

same logs are seen here

@Yunnglin It looks like the optimizer won't work as long as the LoRA parameter is fp16. I hacked into the code and kept the model parameters to fp16 but changed...

@JThh Looking forward for a fix regarding this! I suspect something is wrong during the lora parameter optimization.

> It seems similar to the contents of this proposal: #1731 > > It would be better to implement the function for an LLM to judge and select prompts directly...

> Hey all > > We have added a feature in the CustomComponent that can fulfill that role even if not ideal yet. > > **Disclaimer: This is still experimental**...

@tazarov Thank you for the answer! I am wondering if the situation has been changed and whether there are any updates.

Got the same issue.

I got the same error with GPT-J 6B