502 error from github_pull_request
Describe the bug
When querying the table github_pull_request, I am getting partial table followed by the following error:
[ERROR] 1737904724752: github_pull_request: api_error="non-200 OK status code: 502 Bad Gateway body: \"{\n \\"data\\": null,\n \\"errors\\":[\n {\n \\"message\\":\\"Something went wrong while executing your query. This may be the result of a timeout, or it could be a GitHub bug. Please include 6077:36DAD4:7DED00:FC1C21:67965282 when reporting this issue.\\"\n }\n ]\n}\n\""
Plugin version (steampipe plugin list)
0.44.0
To reproduce
run steampipe_export_github github_pull_request --where 'repository_full_name in ("<repo_with_1600_prs>")'
Expected behavior get the full table
Additional context
sometimes I also get unexpected EOF
Hi @nogarab,
Apologies for the issue you're encountering. It is likely due to a large number of PRs in your environment. The GitHub API imposes a 10-second time limit per request, and if the request takes longer, it results in an error.
To address this, I've pushed an update to the issue-471 branch, adjusting the page size to 100 per request. Could you please try it out and experiment with the page size value to find the best fit for your environment?
Let me know if you need any further assistance. Thanks!
This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 30 days.
@nogarab, as we haven’t heard back in a while, we’re going to close this issue for now.
If you’re still encountering the problem or have additional details to share, feel free to comment or reopen the issue — we’ll be happy to take another look!