SamuelSiu

> You can try `pip3 install -v -e ./` to check if the build is successful. thanks, it's my mistake, the version of cmake is incorrect.

> You can try `pip3 install -v -e ./` to check if the build is successful. I found anther problem, is the model file exported by export_lighseq.py in a fp16...

大佬牛逼，太敬业了

> 8k训练，可以外推32k 请问8k训练的时候base就是1000000吗？

其实比较想知道qwen 72B的外推训练方案是否和codellama类似，短文本先长时间pretrain，再修改base到100000进行8k长文本的continue pretrain？

> I have been installing all of the extensions via those commands for 2 days now; I also tried using the release v2.0.1 code zip let me try this once...