elementary icon indicating copy to clipboard operation
elementary copied to clipboard

Allow file format change for Glue adapter

Open Jeremynadal33 opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe. This is to complete issue #177 . I added PRs dbt-data-reliability and elementary for allowing Glue adapter with Delta file format. It then requires a configuration that allow Delta tables from the Glue session. We should add the possibility to use other file formats.

Describe the solution you'd like I think we should add a macro that allow a new configuration to be passed to choose the file format with a verification that the file format allows incremental loads.

Describe alternatives you've considered N/A

Additional context Not sure if that is relevant or possible but I feel like we should check if the Glue session is able to use the file format.

Would you be willing to contribute this feature? I would like to but I don't have time for now...

Jeremynadal33 avatar Oct 01 '24 12:10 Jeremynadal33

Hi @Jeremynadal33 ! Thanks a lot for your contribution of the Glue adapter, and for this issue. Will look at the contribution when I can, in any case makes sense this is a separate issue.

haritamar avatar Oct 02 '24 08:10 haritamar