Matthew Powers
Matthew Powers
@danielbeach - Apparently OSS Delta Lake doesn't support Spark Connect yet 😢
@robertkossendey - could you grab this?
Sounds good to me. Only worry is that we won't be able to access the necessary information from the transaction log without using private methods. The Delta Rust transaction log...
@huynguyent - you can add this function to levi if you'd like: https://github.com/MrPowers/levi There is a `get_add_actions` method in Delta Rust that probably exposes the necessary details: https://delta-io.github.io/delta-rs/api/delta_table/#deltalake.DeltaTable.get_add_actions
Yes, I like this idea, thank you for making this suggestion. Would be great for someone to grab this.
@robertkossendey - yea, an issue template with "I would like to contribute" would be great as well. Good idea!
@danielbeach - I am getting this error: ``` > spark.sql(f"ALTER TABLE {delta_table.name} RENAME TO {new_table_name}") E AttributeError: 'DeltaTable' object has no attribute 'name' ``` I'm not sure the current code...
@danielbeach - I don't think the current code tests `databricks=True`.
@danielbeach - thanks for the ping. I think [you already fixed this](https://github.com/MrPowers/mack/pull/126), so closing this PR. Thanks!
@Amrit-Hub - thanks for commenting. Can you please open a PR with your code? Can you also add tests to demonstrate why this implementation is better? Thank you!