airbyte-connectors icon indicating copy to clipboard operation
airbyte-connectors copied to clipboard

Bitbucket sync fails with Too Many Requests

Open HumbleBeck opened this issue 8 months ago • 0 comments

Bitbucket sync fails occasionally with Too Many Requests.

Encountered an error while reading stream commits: Error fetching commit(s) for repository "org/repo": Too Many Requests
Stack Trace: VError: Error fetching commit(s) for repository "org/repo": Too Many Requests
    at Bitbucket.getCommits (/home/node/airbyte/sources/bitbucket-source/lib/bitbucket/bitbucket.js:123:19)
    at async Commits.readRecords (/home/node/airbyte/sources/bitbucket-source/lib/streams/commits.js:40:9)
    at async BitbucketSource.doReadStream (/home/node/airbyte/faros-airbyte-cdk/lib/sources/source-base.js:190:34)
    at async BitbucketSource.readStream (/home/node/airbyte/faros-airbyte-cdk/lib/sources/source-base.js:164:26)
    at async BitbucketSource.read (/home/node/airbyte/faros-airbyte-cdk/lib/sources/source-base.js:110:34)
    at async Command.<anonymous> (/home/node/airbyte/faros-airbyte-cdk/lib/sources/source-runner.js:100:34)
    at async Command.parseAsync (/home/node/airbyte/node_modules/commander/lib/command.js:935:5)

We have quite a few repositories with quite a few commits. There is no way for us to configure the rate limit via UI. Any suggestions?

HumbleBeck avatar Jun 07 '24 22:06 HumbleBeck