Kaxil Naik
Kaxil Naik
This builds on top of [Dynamic Tasks Mapping](https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html) released in Airflow 2.3 and is similar to https://github.com/astronomer/astro-sdk/issues/507 ```python get_value_list(‘select product from products’, db_conn) ``` Iterating over a set of files...
We have tons of redundant integration tests that test the same functionality and we don't have a clear separation of unit tests and integration tests. Acceptance Criteria: - [ ]...
The test (`tests/databases/test_bigquery.py::test_bigquery_create_table_with_columns[bigquery]`) on main and some of the PRs are failing with the following error ``` FAILED tests/databases/test_bigquery.py::test_bigquery_create_table_with_columns[bigquery] > assert rows[0] == ( "astronomer-dag-authoring", f"***table.metadata.schema***", f"***table.name***", "id", 1, "NO",...
Details: https://peps.python.org/pep-0563/ and https://discuss.python.org/t/type-annotations-pep-649-and-pep-563/11363/20 tl_dr: This PEP lazy evaluates Annotations so they are not evaluated at parse time and allows forward references as well. This also includes https://peps.python.org/pep-0604/ which allows...
Similar to how we currently support BigQuery and Snowflake, let's add support for Redshift too. This issue only needs the "pandas" path so should be straightforward. Look into the [Bigquery](https://github.com/astronomer/astro-sdk/blob/main/src/astro/databases/google/bigquery.py)...
Instead of hard-coding the docs in the [GETTING_STARTED.md](https://github.com/astronomer/astro-sdk/blob/main/docs/getting-started/GETTING_STARTED.md), we should use the following code to extract the code from example DAGs so it doesn't go out of date. ```{literalinclude} ../../example_dags/example_amazon_s3_postgres.py...
There will be an alpha build of 2.4 very soon (Sync with the Ash/Jed to get the tag), so to make sure Python SDK can use 2.4 dataset feature (and...
Currently, we allow users to pass a SQL file to the `sql` param in the transform decorator and `TransformOperator`. This is handled by the following code: https://github.com/astronomer/astro-sdk/blob/6b90c92029c7470f5e383345fcdaf77861c8cb94/src/astro/sql/operators/base_decorator.py#L111-L113 We should add...