datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Add substrait support for multiple files in `ReadType::LocalFiles`

Open alamb opened this issue 1 year ago • 1 comments

Is your feature request related to a problem or challenge?

@Lordworms added intiial support for ReadType::LocalFiles in https://github.com/apache/datafusion/pull/10842 but it does not yet support multiple files. See the TODO https://github.com/apache/datafusion/pull/10842/files#r1633410593

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

alamb avatar Jun 11 '24 01:06 alamb

I'm thinking of taking this next. From a cursory look at the options available, rewriting the implementation to use ListingTables looks most appropriate to me, does that sound right?

tokoko avatar Oct 20 '24 23:10 tokoko