airbyte
airbyte copied to clipboard
Destination Mysql: DV2
ported from https://github.com/airbytehq/airbyte/pull/34609 to use the kotlin cdk.
As a reminder, we're not doing any safe_cast stuff for mysql. I ran some manual tests in the perf test workspace; see Slack for summary.
We're generating (basically) the same data types as legacy normalization. The only diffs are numbers changing from float -> decimal(38, 9) (float only has 32-bit precision, so was causing problems) and timestamps changing from text -> varchar(1024).
Also we're adding new indexes - normalization was previously creating no indexes at all on the final table; we now have indexes on (extracted_at, pk, cursor), (extracted_at), and (raw_id). Legacy normalization and dv2 both index the raw table on raw_id; dv2 also indexes on loaded_at, extracted_at and extracted_at.
The latest updates on your projects. Learn more about Vercel for Git ↗︎
1 Ignored Deployment
| Name | Status | Preview | Comments | Updated (UTC) |
|---|---|---|---|---|
| airbyte-docs | ⬜️ Ignored (Inspect) | Visit Preview | May 3, 2024 8:30pm |
- #36936
👈 - #36935
: 5 other dependent PRs (#34611
, #34612
, #34613
and 2 others) - #36929

- #36926

master
This stack of pull requests is managed by Graphite. Learn more about stacking.
Join @edgao and the rest of your teammates on
Graphite