astro-sdk
astro-sdk copied to clipboard
DuckDB integration does not use published wheel on Astro runtime
Describe the bug
When building an Astro runtime image with the Astro SDK DuckDB submodule the published DuckDB wheel is not used and instead it is compiled locally, which takes many minutes and also requires installing the gcc compiler on the image.
Version
- Astro SDK: 1.6.1
- Astro runtime: 8.4.0
- OS: macOS
To Reproduce Steps to reproduce the behavior:
- Create a new Astro CLI project with
astro dev init - Modify
requirements.txtto have the lineastro-sdk-python[duckdb]==1.6.1 - Modify
packages.txtto have the lineg++(gccis required to build the wheel) - Start the Airflow instance with
astro dev start - See that it takes ~5 minutes to build the DuckDB wheel
Expected behavior The published DuckDB wheels to be used instead of building it locally.