Andrew Lamb

This is a good proposal I think -- it would skip unecessary filtering and likely make plans faster. It will become more useful (maybe even necessary) when predicate pushdown is...

I'll try and look into this in more detail tomorrow

I am going to find time sometime this week

## Background Reading Here is a background article about parquet predicate pushdown: https://www.influxdata.com/blog/querying-parquet-millisecond-latency/#heading5 Specifically the section on `Late materialization` describes what is done in the RowFilter code ## Code links...

I think there are likely two things needed for this PR: 1. Some API that ListingTable can use to determine if the predicates can be pushed down 2. Tests that...

FWIW I think @itsjunetime is looking into this ticket

> No need to rush. I think @alamb's comment was mostly meant as an assignment signal, so that nobody else starts to work on it and we end up wasting...

I filed https://github.com/apache/datafusion/issues/12115 to track some additional testing that I would like to do for this feature.

There is a nice PR here for this feature: https://github.com/apache/datafusion/pull/12135

I think you could parse the dollar quoted string again with SQLParser as a potential workaround 🤔