xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard
Published 4 days ago • verified publisher icon InternLM

[Enhancement] Optimizing Memory Usage during ZeRO Checkpoint Convert

Open pppppM opened this issue 1 year ago • 0 comments

Mixtral 8x7B ZeRO3 : 110GB Mistral 7B ZeRO3: 15GB

pppppM avatar Apr 18 '24 12:04 pppppM