Peter Toth
Peter Toth
@cloud-fan, I've updates this PR that `removeRedundantAliases` will always keep aliases to avoid duplicate output attributes. Remaining failures in sparkr/linters tests don't seem related to this change.
> > Fixes AliasAwareOutputPartitioning and AliasAwareOutputOrdering as testing discovered that ... > > Can we create a new PR for this? Sure, I can open a new one for this...
> @peter-toth do you know which Spark version starts to have this issue? This rule is quite old so I just ran a quick check on the latest 2.4 branch...
> The GA failure is unrelated, thanks, merging to master! > > Since there are conflicts, can you create backport PRs for 3.3? thanks! Thanks for the review @cloud-fan! I've...
Thanks for letting me know about that issue. I will check it with the updated Jetty version.
@coheigea , unfortunately I didn't have time to check http mode, but we are using version 9.4.26.v20200117 now.
> @peter-toth mind rebasing or retriggering the build? it should be fixed now. Thanks. Done.
Full stacktrace for the reference: ``` org.apache.hadoop.hive.ql.metadata.HiveException: Bucket columns B_C is not part of the table columns ([FieldSchema(name:c, type:string, comment:null), FieldSchema(name:b_c, type:string, comment:null)] org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: Bucket columns B_C is not...
@HyukjinKwon, @dongjoon-hyun could you please take a loot at this PR?
cc @cloud-fan too