aws-sdk-pandas icon indicating copy to clipboard operation
aws-sdk-pandas copied to clipboard

Upsert column parameters

Open SoumayaMauthoorMOJ opened this issue 1 year ago • 1 comments

Is your idea related to a problem? Please describe. The api for glue columns includes Parameters. However none of the aws-sdk-pandas functions allows you to set or update the column Parameters so we have to resort to boto3 update_table.

Describe the solution you'd like Create new function similar to upsert_table_parameters but for columns:

pars = wr.catalog.upsert_column_parameters(
    parameters={"source": "mysql", "destination":  "datalake"},
    database="...",
    table="...",
    column="..."
)

This could be used to flag primary keys, foreign keys, and various other attributes which Glue data catalog does not currently support

SoumayaMauthoorMOJ avatar May 07 '24 16:05 SoumayaMauthoorMOJ

My worry is that we would be polluting the library with additional APIs that have little value. By extension, we can also add upsert_columns_comments, upsert_columns_types. Aim of the library is to facilitate pandas operations and none are involved here. Keen to hear from other contributors though

jaidisido avatar May 10 '24 16:05 jaidisido

Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 7 days it will automatically be closed.

github-actions[bot] avatar Jul 09 '24 18:07 github-actions[bot]