aws-sdk-pandas
aws-sdk-pandas copied to clipboard
Add table_type property to create_ctas_table to support iceberg tables
Is your idea related to a problem? Please describe. Iceberg has a lot of nice features we'd like to use, and AWS create table as supports it now out of the box. It'd be great if the create_ctas_table allowed us to specify the table type to be either hive or iceberg as per the spec linked before.
Describe the solution you'd like
create_ctas_table has a new kwarg, table_type. It would also change external_location to location based on Hive vs Iceberg table type, in addition to changing partitioned_by to partitioning
Alternatively, the function could be made more general by adding a kwarg additional_table_properties which allows end users to do what they want instead of restricting things to a subset of keywords.
I'd be happy to submit a PR for this if the concept sounds good.
This makes sense to me and a contribution would be welcome @Samreay
Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.