Tathagata Das

Results 64 comments of Tathagata Das

Please update the title and description.

I am trying catch up to the discussion and think about it a little. my biggest fear is that if we attempt to duplicate any resolution / unresolution code path,...

Yes, this is a limitation. I dont remember the exact details because this was implemented a while ago, but it was an issue with how apache spark query plan support...

@edmondo1984 thank you for doing this and my apologies for not getting to this earlier (was down with covid). gonna review this today

Hey @edmondo1984 . Thank you for answering my questions and all the updates. Most of the changes look good. except the need for two env variables. Just trying to minimize...

> I think larger workers are more user friendly than breaking down the tests into splits in the CI/CD pipeline, what do you think? I agree that larger workers (self...

@kpe Can you clarify something? are you saying that when iceberg uses `PARTITIONED BY (transform(column))`, then `SELECT *` does not show that generated partition column? Then how do users inspect...

@kpe I see! Thank you for giving that additional information! Definitely food for thought for us.

Yes, we did add support for simple SQL commands like `DESCRIBE HISTORY` by providing a SparkSession extension that users can add to their session. What this extension does is inject...