Andy Grove comments

Results 657 comments of


                                            Andy Grove

Files without `.parquet`, `.csv` extension inferred as having no schema

Some notes from investigating this. This is where the `EmptyExec` gets introduced. I ran into this issue in Ballista as well in https://github.com/apache/arrow-ballista/pull/414 ```rust // if no files need to...

Files without `.parquet`, `.csv` extension inferred as having no schema

I propose that the error check we add is that at least one file exists with the specified extension.

Break datafusion crate into smaller crates

This will be helpful for use cases where users are looking to use DataFusion in a similar fashion to Calcite, for query parsing and planning, but not for execution. I...

Better not to display partitions info for ParquetExec

Perhaps we can make this configurable using the new config mechanism

EPIC: Improve Documentation, Tutorials, and Examples

Thanks @kmitchener that is great feedback

Remove offset if its zero

LGTM @turbo1912. Could you update the rustdoc at the top of the file now that this optimizes both limits and offsets? I think it makes sense for these related optimizations...

Add SQL query planner support for time literal

Converting to draft as this isn't enough. ``` SELECT TIME '08:08:00.091' AS "T"; Internal("Unsupported CAST from Utf8 to Time32(Millisecond)") ```

Add SQL query planner support for time literal

Closing this in favor of https://github.com/apache/arrow-datafusion/pull/3010

optimize/simplify the literal data type and remove unnecessary cast、try_cast

+1 for optimization rules to perform type coercion in the logical plan. I am running into some issues around this myself and am seeing quite a lot of inconsistencies in...

Can I Filter Files During Multi-File Query?

I think the solution here would be to implement a specialized version of `https://docs.rs/object_store/latest/object_store/trait.ObjectStore.html#tymethod.list` where a function can be passed to determine which files get selected (based on file names)....