spark-daria
spark-daria copied to clipboard
Lenient schema validation
(This single commit PR requires the deep DF validation changes) When validating data against a schema, it verifies that all field elements are the same.
However, a data frame column that is specified as non-null should be considered valid against a schema column that allows nulls.
This PR implements that change.
This is draft simply because #144 has not been merged.