NeMo-Curator
NeMo-Curator copied to clipboard
Improve Pytorch Model Performance
trafficstars
Improve Perf by adding model compilation:
- [ ] https://github.com/rapidsai/crossfit/issues/90
- [ ] Possible Memory Estimation Issue Leading to OOMs and Restarts #72
- [ ] Semantic dedup (uses Crossfit / PyTorch) gets stuck with UCX #283