airbyte
airbyte copied to clipboard
Java CDK updates for mysql
ported from https://github.com/airbytehq/airbyte/pull/34608 to kotlin.
- TestDatabase
- general cleanup (nullability, etc)
ConfigBuilder.build()now declares ObjectNode as its return type for convenience
- AbstractJdbcDestination - allow injecting a custom v1v2 migrator
- JdbcDestinationHandler
- Make databaseName nullable (see comment for reason)
- allow overriding the data type for
_airbyte_destination_state.updated_at(mysql doesn't have a timestamp_with_timezone type) - allow overriding a few DB metadata-related things (mysql doesn't have schemas, so need to pass
namespaceinto thedatabaseargument) - type name comparison now uses
.equals(..., ignoreCase=true)
- JdbcSqlGenerator
- add a
formatTimestampLiteralmethod - kill the createIndexes method - implementing classes can just return a
Sqlobject with multiple statements - use dslContext everywhere instead of static DSL
- allow overriding
renameTableandcreateV2RawTableFromV1Table(once again, to support mysql quirks)
- add a
- JdbcV1V2Migrator - more
openstuff, makedatabaseNamenullable - JdbcSqlGeneratorIntegrationTest - nullability, make
dslContextprotected instead of private - JdbcTypingDedupingTest
- make more things open/protected
- call
convertStreamNameon the raw table namespace (this is to match the JdbcSqlGenerator behavior, so that tests can correctly find the raw table) - more DSL -> dslContext changes
- JdbcBufferedConsumerFactory - use ParsedCatalog as source of truth for raw table name
- JdbcSqlOperations: modify airbyte_meta handling (write explicit value when null)
- CatalogParser - correctly propagate the original stream name+namespace when there are table name collisions
- BaseTypingDedupingTest
- add more tests/assertions
- misc code cleanup
- lots of making things nonnullable
The latest updates on your projects. Learn more about Vercel for Git ↗︎
1 Ignored Deployment
| Name | Status | Preview | Comments | Updated (UTC) |
|---|---|---|---|---|
| airbyte-docs | ⬜️ Ignored (Inspect) | Visit Preview | May 3, 2024 7:38pm |
This stack of pull requests is managed by Graphite. Learn more about stacking.
Join @edgao and the rest of your teammates on
Graphite
made a few minor changes to handle mysql's spec using database instead of schema for the default namespace field, plus merge conflicts (more nullability stuff, and a new @Suppress(deprecation) thing)
... and fixed SpecModifyingDestination to correctly proxy the isV2Destination call to the underlying destination object
/publish-java-cdk
:clock2: https://github.com/airbytehq/airbyte/actions/runs/8944047470 :white_check_mark: Successfully published Java CDK version=0.32.0!