Andrew Lamb

Nice -- thanks @devinjdangelo I was thinking about potential ways to organize the crates. One potential in my mind was ``` datafusion-catalog (has TableProvider, CatalogProvider, etc, maybe Mem*Provider) datafusion-catalog-listing (ListingTable)...

I see this PR and plan to review it, hopefully today but likely tomorrow (Mon)

@comphead I wonder if you have time to re-review this PR?

Thanks again @peter-toth and @comphead

I believe this issue is now complete. The compatibility matrix page is here: - https://parquet.apache.org/docs/file-format/implementationstatus/ @pitrou if you agree, as the original reporter, perhaps you can close this issue (I...

I looked into this -- One of the major challenges is that `SessionState's` constructor basically installs the "pre-provided" functionality (like data sources, etc https://github.com/apache/datafusion/blob/78055fe13b64cdfb4accd131e9a462770c21a934/datafusion/core/src/execution/session_state.rs#L190-L295 One way to handle this would...

I made https://github.com/apache/datafusion/pull/11183 to start breaking apart the API and implementation -- there is still a ways to go

> I think to accomplish these goals core will need to be refactored into a number of different crates to avoid circular dependencies and allow core to still offer a...

The more I think about this the more I think trying to make `SessionState` a container that doesn't have all the optional features (like parquet support) by default makes sense...

> The more I think about this the more I think trying to make `SessionState` a container that doesn't have all the optional features (like parquet support) by default makes...