airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Source Postgres: non-string data types sent to destination as strings

Open adam-bloom opened this issue 2 years ago • 0 comments

Environment

  • Airbyte version: 0.40.28 (but this has existed for at least 6+ months)
  • OS Version / Instance: AWS EC2
  • Deployment: k8s EKS
  • Source Connector and version: Postgres 1.0.38
  • Destination Connector and version: Redshift 0.3.53
  • Step where error happened: Sync job

Current Behavior

Potentially related to #21695.

All numeric data types in postgres are sent to the destinations as strings. We're using raw loading, no normalization. It doesn't make much sense that normalization would need to convert strings back to numeric types, since numeric types can be loaded directly in the destinations.

Expected Behavior

I expect the _airbyte_data object to hold numeric values for columns that are numeric in the source.

Logs

Steps to Reproduce

Are you willing to submit a PR?

Maybe

adam-bloom avatar Jan 27 '23 16:01 adam-bloom