astro-sdk
astro-sdk copied to clipboard
Fix Snowflake native load for 10GB benchmark dataset
Context
When running the Snowflake benchmark as part of #544, there was an error with the 10GB dataset - and for this reason, we haven't added the metrics for it: https://github.com/astronomer/astro-sdk/blob/main/tests/benchmark/results.md
Acceptance criteria
- [ ] Reproduce the error by running
make run_jobin the benchmark folder - [ ] Troubleshoot it
- [ ] Fix any potential issues