astro-sdk

astro-sdk copied to clipboard

Trying to replicate an issue with Redshift

1

utkarsharma2

Add note for redshift issue

1

Add a note for the redshift issue with the gen2 instance issue.

utkarsharma2

Once we have update from the AWS regarding the redshift issue, we should revert the change is PR - https://github.com/astronomer/astro-sdk/pull/1975 Case created with AWS: https://support.console.aws.amazon.com/support/home?region=us-east-2#/case/?displayId=12988936661&language=en

utkarsharma2

Databricks permission issue to access S3

11

**Describe the bug** Currently, the CI is failing for Databricks. More details can be found at: https://astronomer.astronomer.run/dhb539ck/log?dag_id=example_load_file&task_id=load_file__23&execution_date=2023-02-08T00%3A00%3A00%2B00%3A00&map_index=-1

sunank200

Add git job for the creating/deleting redshift cluster

1

This PR adds the logic to create and delete redshift clusters on the fly. Covers 1. Gitaction 2. Master DAG

utkarsharma2

Load file S3 to databricks failing

1

**Describe the bug** A clear and concise description of what the bug is. Load file from S3 to data bricks is failing intermittently: ``` Seems like this job was terminated...

sunank200

**Describe the bug** When building an Astro runtime image with the Astro SDK DuckDB submodule the published DuckDB wheel is not used and instead it is compiled locally, which takes...

jeremybeard

Example dag failing with raise ImportError(f"{classname} was not found in allow list for import")

1

**Describe the bug** Example dag which used to pass now fails failing with error on airflow v2.5.1 **Version** * OS: Linux **To Reproduce** Steps to reproduce the behavior: 1. Write...

kelechi2020

Add example DAG for databricks delta support

5

# Description ## What is the current behavior? The Astro SDK currently does not have an example for loading, transforming, and processing data using Databricks' delta tables. ## What is...

dimberman

**Please describe the feature you'd like to see** The serialization methods on Pandas DFs accept quite a few kwargs which we're not currently exposing. One example is the `index=True|False` parameter...

ianbuss