Felipe Calixto Filho

I have read the CLA Document and I hereby sign the CLA

@sfc-gh-aling , thanks for thinking about it. Just a plus comment I already create a PR with the changes: https://github.com/snowflakedb/snowpark-python/pull/813 In my company's project, we have been using this implementation,...

I hope I can help others, as it helped me. I think it can be a good start solution because we just need to do 2 minor changes. All details...

> @calixtofelipe Thanks! It seems that your PR looks very similar to my original PR (#1579) but at that time it introduced another issue. Let me share something we observed...

> FYI I have a customer who needs to set `spark.databricks.delta.catalog.update.hiveSchema.enabled = true` because the schema isn't being correctly written into Glue unless this option is utilized. I didn't find...

> @calixtofelipe Thanks! It seems that your PR looks very similar to my original PR (#1579) but at that time it introduced another issue. Let me share something we observed...

> Thanks for clarifying it. I confirmed that your PR won't cause the same issue that I experienced. BTW, if I understand it correctly, your PR solves only the Issue...

> I agree, Issue 1 is more critical than Issue 2. Thanks for clarifying it. It may be better to explicitly mention that this PR solves Issue 1 of #1679...

> Hi @calixtofelipe, which conf are you using to run it on AWS Glue? > > I mean not only spark.conf `spark.databricks.delta.fixSchema.GlueCatalog`. Additional argument such as --extra-py-files and --extra-jars Yes,...