Blake Orth
Blake Orth
I've been investigating performance when using the `ListingTable` with remote storage, and since `datafusion-cli` ultimately uses the `ListingTable` I'm curious if my findings might be interesting and related to this...
At the end of the day I'm going to be working on some way to get listing resulted cached, and I'd much rather make those changes here to contribute back...
@alamb I have some freshly minted test results from using both my POC for normalizing the access patterns of hive partitioned datasets and flat datasets when using the `ListingTable` as...
@alamb > If you are willing to potentially help with this work, I can spec it out in a ticket / epic. This sounds great. As you've likely noted I've...
@alamb I think additional observability tooling is almost always a positive development. That being said, I have to be completely honest with you and note that I'm ultimately an API...
> I believe the most valuable think you can do is write up the usecases / file tickets @alamb done, I've filed #17211 which describes my use case and some...
@Yuvraj-cyborg I think you generally have the idea right! > modifying the get_with_extra method to accept the table's base path as the Extra parameter In my mind this should be...
@alamb I haven't pushed and opened a PR for #17211 yet, but I would be happy to do so if we want to start getting some feedback on the implementation....
@alamb Can you add this ticket to the enhancements checklist for us? - https://github.com/apache/datafusion/issues/18827
@alamb Can you add this ticket to the enhancements checklist for us? - https://github.com/apache/datafusion/issues/19273