PyAirbyte
PyAirbyte copied to clipboard
Feat: Support Snowflake's travel time
Summary
Update sql_processor to allow adding "custom" extra clause at the end of the CREATE TABLE statement.
Update Snowflake processor to add an extra clause DATA_RETENTION_TIME_IN_DAYS
to configure Time Travel.
This is a follow up of a conversation on Slack to have feature parity with Airbyte (PR)
Summary by CodeRabbit
-
New Features
- Introduced an optional field for data retention time in Snowflake configurations.
- Enhanced SQL table creation with the ability to include additional clauses and dynamic primary key definitions.
-
Bug Fixes
- Improved validation of SQL command generation for data retention settings in Snowflake.
-
Tests
- Added unit tests to verify data retention time handling in Snowflake table creation.