FastETL

FastETL copied to clipboard

Adapt the method **create_table_if_not_exists** to incorporate query sources, not just existing source tables. There are instances where we need to execute a transformation on the source data to generate a...

edulauer

Create hook and operator for Documents shared in MS Sharepoint, based on the same features avaliable in GSheetHook.

edulauer

There are situations where it's necessary to copy partial data to a table that contains historical series of information, for example, monthly data. In this case, we need to first...

washolive

When db_to_db_operator automatically tries to create postgresql table "if not exists", raises 'SQL Error [42601]: ERROR: syntax error at or near "MAX"'.

washolive

* Automate the creation of the twin table and removal at the end * Turn into an Airflow Operator * Allow reading from MsSql and writing to Postgres * Allow...

vitorbellini

* Change Postgres connection to pyodbc * Allow inserting the load date in the destination table

vitorbellini

Decidir o formato padrão para doscstrings no repositório

1

Precisamos decidir um formato padrão para usar nas docstrings do repositório, documentá-lo nas instruções de contribuição e adaptar as docstrings em todos os módulos Python para que fiquem em conformidade...

augusto-herrmann

The incremental load functions (`_build_incremental_sqls` and [`sync_db_2_db`](https://github.com/economiagovbr/FastETL/blob/main/custom_functions/fast_etl.py#L580](https://github.com/economiagovbr/FastETL/blob/1400cb033a98ffdf828504157edbd14c8ef86505/custom_functions/fast_etl.py#L580))) currently only support a single primary key column. The parameter should be a list of primary keys and the functions should support multiple...

augusto-herrmann

Parameter `column_list` [has wrong type hint](https://github.com/economiagovbr/FastETL/blob/main/custom_functions/fast_etl.py#L559): `str`, but is used as a list a few lines below.

augusto-herrmann

The function `_build_incremental_sqls` is named as an internal function (starts with `_`) but is actually imported directly and used by external modules. It should be renamed appropriately.

augusto-herrmann