ibis icon indicating copy to clipboard operation
ibis copied to clipboard

feat: Datafusion add support for using a list of paths when reading csv parquet etc

Open djouallah opened this issue 1 year ago • 3 comments

Is your feature request related to a problem?

currently when reading csv/parquet, I can't pass a list of paths read_csv(self, path, table_name=None, **kwargs)

What is the motivation behind your request?

No response

Describe the solution you'd like

support a list of paths, the same way as currently supported in duckdb

What version of ibis are you running?

0.9.3

What backend(s) are you using, if any?

Datafusion

Code of Conduct

  • [X] I agree to follow this project's Code of Conduct

djouallah avatar Aug 19 '24 04:08 djouallah

@mesejo Any interest in creating a PR for this?

cpcloud avatar Aug 19 '24 15:08 cpcloud

I can take a swing at it

mesejo avatar Aug 19 '24 15:08 mesejo

The feature was not readily available in DataFusion, but it will be once this PR is merged and released.

mesejo avatar Aug 19 '24 20:08 mesejo