astro-sdk

astro-sdk copied to clipboard

**Please describe the feature you'd like to see** Make it more explicit in the [documentation here](https://astro-sdk-python.readthedocs.io/en/latest/astro/sql/operators/load_file.html#supported-native-transfers) that user needs to have `bigquery.jobs.create` permission in the project to be able to...

phanikumv

Support for Python 3.10 with Astro Python SDK

2

I think we do support Py 3.10 for Astro Python SDK -- but we should officially test it out and add a test in CI

kaxil

**Please describe the feature you'd like to see** Currently, our benchmarking job runs for all databases/datasets. We should split it in multiple job based on file size. **Describe the solution...

pankajastro

**Please describe the feature you'd like to see** We use config path which is currently hardcoded in the codebase. Since we want to run different configs for CI, Weekly jobs...

utkarsharma2

**Please describe the feature you'd like to see** We have commented in python-sdk/tests/benchmark/wait_for_completion.sh #kubectl delete job benchmark-"${GIT_HASH}" -n benchmark This is done until we stabilize the benchmarking we need to...

utkarsharma2

**Please describe the feature you'd like to see** Currently, 1. We are passing the benchmarking table via the env variable. 2. The config used for benchmarking is hardcoded in the...

utkarsharma2

Option to use qualifiers in table name in Table object

1

**Please describe the feature you'd like to see** I'd like to be able to create a `Table` object without having to map DB-specific table qualifiers (e.g. a BQ dataset) to...

jeremybeard

Restrict columns while loading from file to table

1

**Please describe the feature you'd like to see** Check if there is a way to restrict the columns while loading from file to table using Astro SDK load_file operator? Example...

phanikumv

**Please describe the feature you'd like to see** It would be nice if the append operator creates the target table if it does not already exist. I am building a...

rossturk

**Please describe the feature you'd like to see** Will Astro SDK be likely to play nicely out of the box with [ExternalPythonOperator](https://github.com/apache/airflow/pull/25780)? Having to choose between environment isolation and the...

collinmcnulty