airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Source Hubspot: URI too large for many properties

Open mariana-s-fernandes opened this issue 1 year ago • 1 comments

Connector Name

source-hubspot

Connector Version

2.0.0

What step the error happened?

During the sync

Relevant information

The deals in my Hubspot instance have lots of properties (~900). When pulling them all, the Hubspot API does not support it due to the request URI being too large. The code should be adapted to loop through batches of properties breaking it down into several requests.

Relevant log output

<html> <head><title>414 Request-URI Too Large</title></head> <body> <center><h1>414 Request-URI Too Large</h1></center> </body> </html>

Contribute

  • [ ] Yes, I want to contribute

mariana-s-fernandes avatar Jan 05 '24 17:01 mariana-s-fernandes

I have the same issue. It's processing very long more 2h with a little data (less 30k rows) => bad performance

viettran97118 avatar Jan 10 '24 04:01 viettran97118