data-juicer
data-juicer copied to clipboard
Is there any issue with the return types of the read, read_json, and read_webdataset functions in the RayDataSet class?
Would it be more appropriate to change the return type of the read, read_json, and read_webdataset functions in the RayDataSet class from RayDataSet to ray.data.Dataset? Because the data returned by the internal implementation of these functions are all of type ray.data.Dataset.