ConsistentID icon indicating copy to clipboard operation
ConsistentID copied to clipboard

Published 20 hours ago • verified publisher icon JackAILab

Question about training datatype

Open ghost opened this issue 11 months ago • 1 comments

I wanted to ask about training datatype. In the scripts, mixed precision is set to bf16 while the provided checkpoint is fp32. What datatype is preferred for training ?

ghost avatar Jan 07 '25 19:01 ghost