astro-sdk

astro-sdk copied to clipboard

Add `Run benchmarking` button on each Pull Request

1

**Please describe the feature you'd like to see** I really wish I could run benchmarking for each Pull Request that a contributor creates on the astro-sdk repo. This enables us...

phanikumv

Investigate memory_rss as a negative number of benchmarking

2

kaxil

**Please describe the feature you'd like to see** 1. Document the config.json 2. All the esoteric features 3. @pankajastro should be able to run benchmarking without any support **Describe the...

utkarsharma2

Explore possibility to make better experience with redshift operator

4

**Please describe the feature you'd like to see** Loading to redshift from s3 seems more complicated than traditional Amazon S3toRedshift operator and also run into the header issue with it....

pankajastro

Fix Redshift tests

3

**Describe the bug** In CI there are flaky tests, we need to fix - https://github.com/astronomer/astro-sdk/actions/runs/3197623724/jobs/5221086373 The following test is flaky i.e. failing every now and then: ``` FAILED tests/sql/operators/test_load_file.py::test_aql_replace_existing_table[redshift] -...

utkarsharma2

Add a global config for col capitalization

2

# Description ## What is the current behavior? Users expressed confusion on why the column names for output tables are lowercased. It's due to this [default setting](https://github.com/astronomer/astro-sdk/blob/main/python-sdk/src/astro/sql/operators/dataframe.py#L110). closes: #917 ##...

utkarsharma2

Streamline Benchmarking Process and add it to CI

1

**Please describe the feature you'd like to see** Currently, we cannot run benchmarking processes for various reasons. 1. Datasets not working for all the databases 2. Datasets are not available...

utkarsharma2

We need to verify the end-to-end CI/Benchmarking is working. 1. Adding a label 2. Cron

utkarsharma2

Add comment on PR with Markdown generated

1

We need to post a comment on the PR as part of benchmarking job.

utkarsharma2

load_file() can handle pattern in file paths which is not explicit in document

1

**Please describe the feature you'd like to see** Currently, the feature of load_file() to handle patterns in the path is not clearly mentioned in the documentation and would be worth...

utkarsharma2