xpang-sf

> You can see a workaround here: https://github.com/substratusai/model-falcon-7b-instruct/blob/430cf5dfda02c0359122d4ef7f9b6d0c01bb3b39/src/train.ipynb > > Effectively I reload the base model in 16 bit to work around the issue. It works fine for my use...

> New link: https://github.com/substratusai/images/blob/main/model-trainer-huggingface/src/train.ipynb Thank you so much!

> New link: https://github.com/substratusai/images/blob/main/model-trainer-huggingface/src/train.ipynb May I ask another baby question: this is training code and saving model code. After model is saved, did you test to load the saved model...

> Yes in substratus.ai we separate model loading, finetuning and serving in separate images. I did check whether the finetuned model provided different results and it did. > > In...

May I ask: when run fine-tuning, the setting should be: train_on_inputs: bool = False , right? why train_on_inputs: bool = True in the code?

May I ask: when run fine-tuning, the setting should be: train_on_inputs: bool = False , right? why train_on_inputs: bool = True in the code?

> Finally i figure out my problem where inference! the saved model file "adapter_model.bin" is not valid,with small size,i replace it with other bin file in the last checkpint directory,the...