astro-sdk
astro-sdk copied to clipboard
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
**Please describe the feature you'd like to see** Test that the DAGs we generate are compatible with all python versions after Python 3.7. **Describe the solution you'd like** We should...
**Please describe the feature you'd like to see** From the moment a SQL project is initialised, we want to ensure all the commands are run using the same version of...
**Please describe the feature you'd like to see** Currently Open lineage has a different definition for Dataset and airflow has a different class for Dataset. The open lineage facets should...
**Describe the bug** Earlier we were using `n2-standard-4` type cluster that we had to change `n2-standard-8` while doing benchmarking for bigger files. We also increased our benchmark pod size to...
# Description ## What is the current behavior? Currently, when using operators inheriting from `BaseSQLDecoratedOperator` we are unable to view the rendered SQL in the UI. closes: #1003 depends on:...
**Please describe the feature you'd like to see** Currently, we have config kept in the Codebase due to which whenever we want to modify it we have to generate a...
just a link to docs.astrnomer.io tutorial on SDK # Description ## What is the current behavior? ## What is the new behavior? - - - ## Does this introduce a...
**Describe the bug** ``` with DAG(dag_id="test", schedule=None, start_date=datetime(1970, 1, 1)) as dag: @aql.transform def select(input_table: Table): return "SELECT * FROM my_db.my_schema.my_table LIMIT 4;" # {{ input_table }} was also failing...
**Please describe the feature you'd like to see** https://www.notion.so/astronomerio/ML-Batch-Inference-with-Astro-SDK-Issues-Summary-0703c2fe6abf485da514b45e5db9651f https://github.com/astronomer/sagemaker-batch-inference/blob/lineage-test/dags/sagemaker-batch-inference.py Relevant thread https://astronomer.slack.com/archives/C02B8SPT93K/p1663942705854959 Tasks: - https://github.com/astronomer/astro-sdk/issues/1667 - Add support for all other databases