astro-sdk

astro-sdk copied to clipboard

# Description - fix local.mk to respect the correct directory - fix container.mk to use native docker compose from Docker Desktop - improve development docs ### Checklist - [x] Extended...

feluelle

updates: - [github.com/Lucas-C/pre-commit-hooks: v1.2.0 → v1.3.0](https://github.com/Lucas-C/pre-commit-hooks/compare/v1.2.0...v1.3.0) - [github.com/psf/black: 22.3.0 → 22.6.0](https://github.com/psf/black/compare/22.3.0...22.6.0) - [github.com/PyCQA/flake8: 4.0.1 → 5.0.4](https://github.com/PyCQA/flake8/compare/4.0.1...5.0.4) - https://github.com/timothycrosley/isort → https://github.com/PyCQA/isort - [github.com/pre-commit/mirrors-mypy: v0.961 → v0.971](https://github.com/pre-commit/mirrors-mypy/compare/v0.961...v0.971) - [github.com/asottile/pyupgrade: v2.34.0 → v2.37.3](https://github.com/asottile/pyupgrade/compare/v2.34.0...v2.37.3)

pre-commit-ci[bot]

This builds on top of [Dynamic Tasks Mapping](https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html) released in Airflow 2.3 and is similar to https://github.com/astronomer/astro-sdk/issues/507 ```python get_value_list(‘select product from products’, db_conn) ``` Iterating over a set of files...

kaxil

We have tons of redundant integration tests that test the same functionality and we don't have a clear separation of unit tests and integration tests. Acceptance Criteria: - [ ]...

kaxil

The test (`tests/databases/test_bigquery.py::test_bigquery_create_table_with_columns[bigquery]`) on main and some of the PRs are failing with the following error ``` FAILED tests/databases/test_bigquery.py::test_bigquery_create_table_with_columns[bigquery] > assert rows[0] == ( "astronomer-dag-authoring", f"***table.metadata.schema***", f"***table.name***", "id", 1, "NO",...

kaxil

kaxil

kaxil

Use lazy evaluated Type Annotations from PEP 563

3

Details: https://peps.python.org/pep-0563/ and https://discuss.python.org/t/type-annotations-pep-649-and-pep-563/11363/20 tl_dr: This PEP lazy evaluates Annotations so they are not evaluated at parse time and allows forward references as well. This also includes https://peps.python.org/pep-0604/ which allows...

kaxil

[DISCUSS] ProcessedTable interface

2

**Please describe the feature you'd like to see** I would like to get table stats or other meta data of the table that was processed via input/output table. **Describe the...

feluelle

Document the partial table use case for different decorators

1

**Describe the bug** Currently, the documentation misses the partial table use case for different decorators. **Expected behaviour** Add the documentation for the partial table use case for different decorators.

sunank200