[MAINTENANCE] Integration tests around s3 batches

[tyler-hoffman]

• [ ] Description of PR changes above includes a link to an existing GitHub issue
• [ ] PR title is prefixed with one of: [BUGFIX], [FEATURE], [DOCS], [MAINTENANCE], [CONTRIB]
• [ ] Code is linted - run invoke lint (uses ruff format + ruff check)
• [ ] Appropriate tests and docs have been updated

For more information about contributing, see Contribute.

After you submit your PR, keep the page open and monitor the statuses of the various checks made by our continuous integration process at the bottom of the page. Please fix any issues that come up and reach out on Slack if you need help. Thanks for contributing!

[netlify[bot]]

✅ Deploy Preview for niobium-lead-7998 canceled.

Name	Link
🔨 Latest commit	4bb8cf73cf81b8dfb2ab231f7c7f764241b4ab63
🔍 Latest deploy log	https://app.netlify.com/sites/niobium-lead-7998/deploys/6634e5931d808600080bc676

[codecov[bot]]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 78.63%. Comparing base (fd560d9) to head (4bb8cf7). Report is 17 commits behind head on develop.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9846      +/-   ##
===========================================
- Coverage    82.51%   78.63%   -3.89%     
===========================================
  Files          504      484      -20     
  Lines        45079    42536    -2543     
===========================================
- Hits         37199    33449    -3750     
- Misses        7880     9087    +1207     

Flag	Coverage Δ
3.10	64.51% <ø> (-1.13%)	:arrow_down:
3.10 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds	?
3.10 aws_deps	?
3.10 big	?
3.10 databricks	?
3.10 filesystem	?
3.10 mssql	?
3.10 mysql	?
3.10 postgresql	?
3.10 snowflake	?
3.10 spark	?
3.10 trino	?
3.11	64.51% <ø> (-1.13%)	:arrow_down:
3.11 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds	53.90% <ø> (+0.59%)	:arrow_up:
3.11 aws_deps	44.86% <ø> (+0.63%)	:arrow_up:
3.11 big	55.98% <ø> (-5.10%)	:arrow_down:
3.11 databricks	46.01% <ø> (+0.74%)	:arrow_up:
3.11 filesystem	61.20% <ø> (-1.33%)	:arrow_down:
3.11 mssql	48.88% <ø> (+0.89%)	:arrow_up:
3.11 mysql	48.93% <ø> (+0.89%)	:arrow_up:
3.11 postgresql	52.79% <ø> (+1.09%)	:arrow_up:
3.11 snowflake	46.64% <ø> (+0.77%)	:arrow_up:
3.11 spark	57.06% <ø> (-0.79%)	:arrow_down:
3.11 trino	50.79% <ø> (-0.23%)	:arrow_down:
3.8	64.54% <ø> (-1.12%)	:arrow_down:
3.8 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds	53.90% <ø> (+0.59%)	:arrow_up:
3.8 aws_deps	44.87% <ø> (+0.63%)	:arrow_up:
3.8 big	55.99% <ø> (-5.10%)	:arrow_down:
3.8 databricks	46.02% <ø> (+0.74%)	:arrow_up:
3.8 filesystem	61.22% <ø> (-1.33%)	:arrow_down:
3.8 mssql	48.86% <ø> (+0.89%)	:arrow_up:
3.8 mysql	48.92% <ø> (+0.89%)	:arrow_up:
3.8 postgresql	52.78% <ø> (+1.09%)	:arrow_up:
3.8 snowflake	46.65% <ø> (+0.78%)	:arrow_up:
3.8 spark	57.02% <ø> (-0.79%)	:arrow_down:
3.8 trino	50.77% <ø> (-0.23%)	:arrow_down:
3.9	64.53% <ø> (-1.12%)	:arrow_down:
3.9 athena or clickhouse or openpyxl or pyarrow or project or sqlite or aws_creds	?
3.9 aws_deps	?
3.9 big	?
3.9 databricks	?
3.9 filesystem	?
3.9 mssql	?
3.9 mysql	?
3.9 postgresql	?
3.9 snowflake	?
3.9 spark	?
3.9 trino	?
cloud	0.00% <ø> (ø)
docs-basic	49.00% <ø> (-2.91%)	:arrow_down:
docs-creds-needed	50.13% <ø> (-2.88%)	:arrow_down:
docs-spark	48.22% <ø> (-3.46%)	:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.