astro-sdk
astro-sdk copied to clipboard
Document the partial table use case for different decorators
Describe the bug Currently, the documentation misses the partial table use case for different decorators.
Expected behaviour Add the documentation for the partial table use case for different decorators.
What do you mean by partial table? Can you expand on this please?
@kaxil If you refer to the example dag - example_snowflake_partial_table_with_append.py
transformed_data = transform_data(
df=extracted_data, output_table=Table(name="homes_data_long")
)
the table is not defined with conn_id, we infer conn_id, database, and schema from first table which is passed to function, and here is the logic of this - https://github.com/astronomer/astro-sdk/blob/a80d95392e8261c14a15ced21c1e3cd0b70ed05a/src/astro/utils/table.py#L73
This is done