long_llama icon indicating copy to clipboard operation
long_llama copied to clipboard

Published 20 hours ago • verified publisher icon CStanKonrad

FoT can only be used for pre-training, can't it be used for instruction fine-tuning?

Open wujiekd opened this issue 1 year ago • 0 comments

I don’t know much about how cross-batch data is loaded during training.

wujiekd avatar Sep 01 '23 08:09 wujiekd