torchacc icon indicating copy to clipboard operation
torchacc copied to clipboard

Published 20 hours ago • verified publisher icon AlibabaPAI

offline consolidate util

Open hanwen-sun opened this issue 4 months ago • 0 comments

Support to consolidate and reshard xls fsdp checkpoints offline.

ToDO:

  1. The time test of 70b model.

hanwen-sun avatar Oct 11 '24 11:10 hanwen-sun