BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard
Published 8 months ago • verified publisher icon microsoft

The resources for QAT

Open sean-jang00 opened this issue 1 year ago • 0 comments

According to the paper, it is mentioned that QAT must start from scratch. Should I understand that performing QAT on 70B models requires as much time and resources as full precision training from scratch?

sean-jang00 avatar Oct 21 '24 09:10 sean-jang00