finetune training code on codellama

[PoseidomWong]

Could you offer the training code on codellama? did it trained on llamaX?

[nlpxucan]

yes, it is the same with the previous wizard models, it is trained on llama-X

[PoseidomWong]

also use train_wizardcoder.py without any modify？

[qaqrt]

I encountered an error while using train_wizardcoder.py. What could be the reason for this? Usage CUDA_VISIBLE_DEVICES=5 deepspeed train_wizardcoder.py