NeMo-Curator
NeMo-Curator copied to clipboard
Curator should support numpy > 2
Is your feature request related to a problem? Please describe. Currently numpy is restricted to < 2. But in cudf 24.10 release numpy allows 2.0 release.
However we tried just removing that version pinning, but it ended up in pip being unable to resolve dependencies.
Describe the solution you'd like
- Support numpy 2
- Be installable with pip
Describe alternatives you've considered
- Tried just removing that pin and installing, but pip wasn't able to resolve packages