Sean Smith

Results 2 comments of Sean Smith

Very limited value of Desktop for pull requests if I can comment on lines.

I exploded the array and flattened the schema and the df's compare fine. ` merge_df = merge_df.withColumn("representatives_check", F.explode("representatives")).drop("representatives") select_exprs, nesting_info = flatten_schema(merge_df.schema, dot_prefix="", flat_prefix="") merge_df = merge_df.select(*select_exprs) expected_df = expected_df.withColumn("representatives_check",...