PyAirbyte icon indicating copy to clipboard operation
PyAirbyte copied to clipboard

do not merge: bananza mode wip

Open aaronsteers opened this issue 4 months ago • 4 comments

Summary by CodeRabbit

  • New Features

    • Added lake storage integration enabling fast unload/load between caches and cloud object storage.
    • Introduced S3 and GCS lake backends with a default path convention; supports per-stream and bulk operations.
    • Enabled fast copy workflows for Snowflake and BigQuery caches to and from lake storage.
  • Documentation

    • Added an example script showcasing an end-to-end Snowflake → S3 → Snowflake data transfer with performance summaries.
  • Chores

    • Exposed lake storage classes at the top-level package for simpler imports.

aaronsteers avatar Aug 07 '25 20:08 aaronsteers