NeMo-Curator icon indicating copy to clipboard operation
NeMo-Curator copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

[FEA] Enable Best Fit Packing

Open VibhuJawa opened this issue 10 months ago • 0 comments

We should look into enabling best fit packing dataset curation feature. This was used by deepseek and seems like we can use our existing bin packing features to enable it so work wise it wont be too big of a lift

Image

https://arxiv.org/pdf/2404.10830

VibhuJawa avatar Jan 21 '25 19:01 VibhuJawa