jitsu icon indicating copy to clipboard operation
jitsu copied to clipboard

incorrect data type mapping for mysql->postgres sync

Open ardabeyazoglu opened this issue 8 months ago • 0 comments

Summary

Airbyte mysql source to postgres sync creates "boolean" columns on destination for "tinyint" columns in mysql. This is incorrect. tinyint is 8-bit column that can take 256 values while boolean is 0-1, and it may cause data loss. I think tinyint should be smallint/int2 on postgres, which is the closest data type.

I set up a self-hosted airbyte to see if it is the same, and it made all integer columns bigint in postgres, regardless of the size. This is also inconvenient but at least it is safe to use.

System configuration and versions

Jitsu next 2.9 airbyte/mysql 3.11.9

ardabeyazoglu avatar Apr 21 '25 19:04 ardabeyazoglu