Jason Lowe

Results 59 comments of Jason Lowe

In offline discussions about this, @revans2 raised an excellent point that ideally we should not do a "one-off" for this. There are other cases where there are common sub-expressions across...

The output implies we're trying to do reuse on AttributeReference. Is that the case, and if so, is that actually helpful in practice? Seems like we would want to avoid...

It's not specific to ORC. The intent is not to preserve the timezone of the file but rather to target a timezone that's specified by the caller. ORC is already...

I ran this on a 16GB V100, so I guess if tests are expected to require more than that this is "working as designed." However it seems a bit excessive...

Curious, does this only happen for dates before the [Julian-Gregorian calendar transition in 1582](https://www.timeanddate.com/calendar/julian-gregorian-switch.html)?

cudf does not support ZSTD. They are in the process of migrating to using [nvcomp](https://github.com/NVIDIA/nvcomp) for handling codecs. nvcomp does not yet support ZSTD, but it is on their radar...

> we do not need to explicitly set spark.sql.autoBroadcastJoinThreshold=10m because this is default value, right? Apologies for the late reply. We need this because it is _not_ the default on...

This change has been pulled into #1018, so this is no longer necessary.

> can you confirm that I am not missing something you needed here? Yep, this is fixed by #6066.

Reopening since #6066 was reverted by #6679