astro-sdk

astro-sdk copied to clipboard

**Describe the bug** When passing a positional argument to an `@aql.dataframe` decorated function, the SDK fails to start the task because of a `KeyError` on the parameter. From looking at...

jeremybeard

**Describe the bug** A clear and concise description of what the bug is. Trying to load a CSV file from AWS into a DuckDB table. The process keeps filling up...

sunank200

**Describe the bug** Currently, the native transfer between GCS and Databricks Delta Table relies on pre-configuration on the Databricks Cluster. The current credentials set within the Astro Python SDK 1.5.2...

tatiana

**Please describe the feature you'd like to see** 1. ~~We can add better unit-test cases where we test the output of `get_openlineage_facets_on_complete` and `get_openlineage_facets_on_start` right now we rely on `Marquez...

utkarsharma2

Bigquery Native Path for Azure Blob storage (WASB)

8

**Please describe the feature you'd like to see** Add native path support for Biquery and Native Path. Ref: https://cloud.google.com/bigquery/docs/omni-azure-create-connection

utkarsharma2

Add dataframe as dataset for Open lineage

4

**Please describe the feature you'd like to see** - Once the specs are added on Open lineage https://github.com/OpenLineage/OpenLineage/blob/main/spec/Naming.md for dataframe, pass the lineage values for input and output facets for...

sunank200

Table naming when expanding a LoadFileOperator

2

**Please describe the feature you'd like to see** The LoadFileOperator accepts `output_table` and `input_file` arguments. When expanding over a set of files, you may want to load them with the...

ReadytoRocc

**Please describe the feature you'd like to see** We need cols values in operators like merge and append. Currently, we need to manually infer it. **Describe the solution you'd like**...

utkarsharma2

load_file replacing existing tables fails if there are views on the tables

1

load_file(if_exists='replace') works the first time a DAG is run. Upstream tasks subsequently create views on that DAG. Rerunning the DAG fails as it cannot drop the existing tables because of...

mpgreg

currently, benchmark CI job is failing because failing to install astro-sdk in container CI log: https://github.com/astronomer/astro-sdk/actions/runs/4910054906/jobs/8766866479

pankajastro