orderer0001
Results
12
comments of
orderer0001
> 我感觉可能和数据集也有关系,或者网络结构也有关系,这一块代码我当时只是把网络结构搭建出来,只用了小数据跑了一下,所以可能自己尝试一下哈、 如果方便的话,是否呢个加个微信沟通 hbtz2000
I fine-tuned Qlora according to this: https://github.com/OpenAccess-AI-Collective/axolotl. After training, part of it is loaded into the cpu when loading. I am using 4090 24g. But my adapter_model.safetensors are only 300mb....