airbyte
airbyte copied to clipboard
Source Hubspot: URI too large for many properties
Connector Name
source-hubspot
Connector Version
2.0.0
What step the error happened?
During the sync
Relevant information
The deals in my Hubspot instance have lots of properties (~900). When pulling them all, the Hubspot API does not support it due to the request URI being too large. The code should be adapted to loop through batches of properties breaking it down into several requests.
Relevant log output
<html> <head><title>414 Request-URI Too Large</title></head> <body> <center><h1>414 Request-URI Too Large</h1></center> </body> </html>
Contribute
- [ ] Yes, I want to contribute
I have the same issue. It's processing very long more 2h with a little data (less 30k rows) => bad performance