Sagar Ahire

Add logging of Spark execution plan to facilitate debugging

3

This PR adds logging for the execution plan for Spark pipelines. The logging can be seen in the full raw logs. Example log: ``` 2022-08-11 20:59:59,771 - DEBUG [spark-submitter-phase-1-725c5b7c-198a-11ed-8838-000000bbd65a:i.c.c.e.s.b.RDDUtils@82] -...

This change does the following: * Creates an expression factory for compiling SQL expressions in one SQL dialect to another * Adds an interface for conversion from one SQL dialect...

This PR adds 2 methods to the `Relation` interface: `addSchema()` to create a new Relation with a schema, and `getSchema()` which returns a schema if available.

Cherry-pick for PR: https://github.com/cdapio/cdap/pull/15077

This PR adds a way to add schema information to a relation. This can be called by a plugin that wishes to request validation. The current intention is that this...

Change inner join e2e test to use GCS and change input files to ensure that inner join drops non-matching records.