astro-sdk

astro-sdk copied to clipboard

**Describe the bug** When using aql.load_file to load data from GCS to BQ, task fails due to authentication error. The GCSToBigQueryOperator is able to run successfully using the Google Cloud...

TheCodyRich

This ticket involves listing down all the scenarios and cases (on a high level) that we want the QA team to test.

kaxil

**Improve** https://astro-sdk.readthedocs.io/en/1.0.0b1/ **Goal** Improve the content itself. **Acceptance criteria** * [ ] Add section about supported technologies: https://github.com/astronomer/astro-sdk#supported-technologies * [ ] API Reference and Changelog should be after the Getting...

tatiana

3 story points **Context** Improve native Snowflake `load_file` to be verbose about `ON_ERROR` issues. TODO: detail **Acceptance criteria** * [ ] By default: throw the error using Validation mode, explain...

tatiana

**Please describe the feature you'd like to see** At the moment, if the user does not define `task_id`, we are naming tasks inconsistently across different operators and decorators. Some are...

tatiana

Set the CI to run and publish benchmark reports once a week

1

**Dependencies** * Depends on: #432 * Depends on: #434 * Depends on: #442 * Depends on one of: * #438 * #431 * #437 **Acceptance criteria** * [ ] The...

tatiana

**Context** When running the Snowflake benchmark as part of #544, there was an error with the 10GB dataset - and for this reason, we haven't added the metrics for it:...

tatiana

Add the ability set task dependency without a data dependency

3

**Please describe the feature you'd like to see** Currently with the Astro SDK there is no easy way to chain together tasks without having a data dependency. Let's take an...

dimberman

**Please describe the feature you'd like to see** Currently, we have only one option per type and size, we should have multiple options for a particular size since there are...

utkarsharma2

**Please describe the feature you'd like to see** Currently, we are only using Source and Destination to determine the transfer logic to be executed - default path / native path....

utkarsharma2