data-juicer
data-juicer copied to clipboard
Add more unittest
- setup local actions runner on a GPU machine
- use docker-compose to setup a cluster
- add more unit tests
- single process
- multi process
- multi process with GPU
- ray with CPU
- ray with GPU