Cyrus Zhang

Results 15 comments of Cyrus Zhang

track it here: https://github.com/modelscope/data-juicer/pull/748/files#diff-352daee681f7f0fd09912b5decdd1d3608dab673e3c343021375470d8b058b9f

Thanks for reaching out, Richard! We also believe the synergy between Ray and DataJuicer provides a great joint adventure! One of the biggest challenges we face in massive parallel data...

here is our PR for comprehensively handling the fault tolerance and job life cycle management; ray has infrastructure level fault tolerance, we are building on top of that https://github.com/modelscope/data-juicer/pull/748 the...