airbyte
airbyte copied to clipboard
Source Postgres: non-string data types sent to destination as strings
Environment
- Airbyte version: 0.40.28 (but this has existed for at least 6+ months)
- OS Version / Instance: AWS EC2
- Deployment: k8s EKS
- Source Connector and version: Postgres 1.0.38
- Destination Connector and version: Redshift 0.3.53
- Step where error happened: Sync job
Current Behavior
Potentially related to #21695.
All numeric data types in postgres are sent to the destinations as strings. We're using raw loading, no normalization. It doesn't make much sense that normalization would need to convert strings back to numeric types, since numeric types can be loaded directly in the destinations.
Expected Behavior
I expect the _airbyte_data object to hold numeric values for columns that are numeric in the source.
Logs
Steps to Reproduce
Are you willing to submit a PR?
Maybe