Google Sheets destination fails when writing a cell value larger than 5000 characters long

[sherifnada]

Environment

• Source Connector and version: Github
• Destination Connector and version: Google Sheets 0.1.1

Current Behavior

The destination fails when writing a cell value containing more than 50k characters

Expected Behavior

I would expect the destination to truncate any values which are about to be larger than 50k characters.

Alternatively I'll take column selection in the platform :)

Logs

logs-473322.txt

Steps to Reproduce

1. Write from any source to a Google Sheet destination a value containing more than 50k chars in a single string stream. I used the oncall Airbyte Github repo
2. It will fail with a 400 error Your input contains more than the maximum of 50000 characters in a single cell.". Details: "Your input contains more than the maximum of 50000 characters in a single cell."

[delenamalan]

@YowanR I can work on this one. However, do you have a preferred solution? Should the value be truncated to 50k characters like @sherifnada suggested?

[YowanR]

Let's go for the truncate route as @sherifnada suggested :D

[sherifnada]

we should make sure it's very clear to the consumer that the value was truncated eg write the string INPUT_TRUNCATED or something in the cell so the user doesn't have to guess

[josix]

May I take this issue? I would like to give it a try.

[justinbchau]

Go for it!

[jrolom]

@josix do you have an update? thanks

[josix]

I was blocked by my work. I'm still working on reproducing the issue.

[akshaysinghas]

Should I give it a try if no one is working on it?

[josix]

Sorry that I still face some credentials issues, it would take longer time than I think, please feel free to assign to other people if possible, thanks.