aws-sdk-pandas
aws-sdk-pandas copied to clipboard
Upsert column parameters
Is your idea related to a problem? Please describe. The api for glue columns includes Parameters. However none of the aws-sdk-pandas functions allows you to set or update the column Parameters so we have to resort to boto3 update_table.
Describe the solution you'd like Create new function similar to upsert_table_parameters but for columns:
pars = wr.catalog.upsert_column_parameters(
parameters={"source": "mysql", "destination": "datalake"},
database="...",
table="...",
column="..."
)
This could be used to flag primary keys, foreign keys, and various other attributes which Glue data catalog does not currently support
My worry is that we would be polluting the library with additional APIs that have little value. By extension, we can also add upsert_columns_comments, upsert_columns_types. Aim of the library is to facilitate pandas operations and none are involved here. Keen to hear from other contributors though
Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.