airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

[source-mongodb] Cannot increase the precision of Numeric type column in postgres destination

Open shubhshah01 opened this issue 1 year ago • 6 comments
trafficstars

Topic

Can't Modify destination column datatype

Relevant information

Is there any other way to modify the data type if not via UI? source: mongoDB I have a column in my destination postgres of type Numeric with precision 38, scale 9 but the value i have has 31 or more digits and hence fails with "ERROR: numeric field overflow". Question 1: how is the precision 38 scale 9 derived by airbyte ? Question 2: How can i increase the precision ? I tried manually changing the precision in postgres column but still the sync failed.

shubhshah01 avatar Apr 17 '24 14:04 shubhshah01

What version of Mongo connector are you using?

marcosmarxm avatar Apr 18 '24 00:04 marcosmarxm

Hey @marcosmarxm, source-mongo: 1.3.3 dest-postgres: 2.0.9 airbyte: 0.57.2

shubhshah01 avatar Apr 18 '24 05:04 shubhshah01

Hello @shubhshah01,

is CDC working for you with incremental sync ??

we are gettting this error for offset

https://github.com/airbytehq/airbyte/issues/36994

DevBey avatar Apr 21 '24 08:04 DevBey

Hello @shubhshah01 can you try latest version of Mongodb connector? Check comment from Akash

marcosmarxm avatar Apr 30 '24 18:04 marcosmarxm

This seems to be a question for the destinations team? Adding them

akashkulk avatar Apr 30 '24 21:04 akashkulk

Sorry, we have no tooling to increase the precision today

evantahler avatar May 01 '24 21:05 evantahler