modin icon indicating copy to clipboard operation
modin copied to clipboard

Support parallel CSV reads for different file schemas (e.g. `gs://`)

Open pyrito opened this issue 3 years ago • 3 comments

Is your feature request related to a problem? Please describe. Currently read_csv only supports parallel reads for s3 and file and any other filesystem backend defaults to pandas. We should try to support the following schemes as well: ftp and gs.

pyrito avatar Aug 01 '22 14:08 pyrito

http(s) support will be added in https://github.com/modin-project/modin/pull/4710

prutskov avatar Aug 01 '22 14:08 prutskov

@prutskov oops yes! I just edited the issue. Thanks for pointing it out.

pyrito avatar Aug 01 '22 14:08 pyrito

Take a look at this discussion (https://github.com/modin-project/modin/pull/4710#discussion_r937833450) when somebody starts to implement this.

prutskov avatar Aug 04 '22 14:08 prutskov

Should be supported as of #4898

pyrito avatar Aug 31 '22 19:08 pyrito