Sean Smith
Results
2
comments of
Sean Smith
Very limited value of Desktop for pull requests if I can comment on lines.
I exploded the array and flattened the schema and the df's compare fine. ` merge_df = merge_df.withColumn("representatives_check", F.explode("representatives")).drop("representatives") select_exprs, nesting_info = flatten_schema(merge_df.schema, dot_prefix="", flat_prefix="") merge_df = merge_df.select(*select_exprs) expected_df = expected_df.withColumn("representatives_check",...