OpenBMB
How to finetune BitCPM4-1B
Do you have a code that I can use to finetune BitCPM. Can I use libraries like unsloth to finetune a 1.58 Bit (BitCPM) model?
Ok let me try.
On Mon, 23 Jun 2025 at 3:21 PM, siddharth28392 @.***> wrote:
siddharth28392 created an issue (OpenBMB/MiniCPM#301) https://github.com/OpenBMB/MiniCPM/issues/301
Do you have a code that I can use to finetune BitCPM. Can I use libraries like unsloth to finetune a 1.58 Bit (BitCPM) model?
— Reply to this email directly, view it on GitHub https://github.com/OpenBMB/MiniCPM/issues/301, or unsubscribe https://github.com/notifications/unsubscribe-auth/BLHMSJKN4DCTBV34GQBCPKD3E7E3DAVCNFSM6AAAAAB744OQYGVHI2DSMVQWIX3LMV43ASLTON2WKOZTGE3DONJSHE4DQMY . You are receiving this because you are subscribed to this thread.Message ID: @.***>
We are preparing to open-source the training code for BitCPM. In contrast, we do not recommend using unsloth to directly fine-tune BitCPM, as this may damage the model parameters’ fake-quantized ternary distribution.
Has the training code for BitCPM been open-sourced? I haven't been able to find it.
