serpapi
Elevated Response Times
UPDATE: We were seeing elevated response times recently. They have come down now, but we'll keep monitoring.
~~We are currently experiencing downtime for our APIs. Some pages on our website are also taking a long time to load, or returning an error. Our Public Status page also shows a sharp increase in overall response times.~~
Public links: Playground 1 | Playground 2 | Status Page
Internal links: Intercom | Intercom 2 | Intercom 3 | Intercom 4
Other reports:
Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom
Front Front Front Front Front Front Front Front
We're experiencing issues with Google Search API for over an hour now, current average response time for it is above 12 seconds.
Same here. It'd be very useful to get more context from the SERP team about what's going on. That chart above doesn't look great.
Hi @miguelrios @Zack-Xb, unfortunately, we do not have an ETA we can share regarding a fix. However, we have marked this issue as the highest priority and are actively working toward a solution.
While we are still investigating, this issue appears to be related to extreme anti-scraping measures Google recently implemented (see #2629). We were able to put a temporary solution in place to restore service on the 17th, but as we work towards a more permanent, stable resolution.
We will continue to post updates here as we have them, thank you both for your patience and understanding while we work through this.
Hi @miguelrios @Zack-Xb, unfortunately, we do not have an ETA we can share regarding a fix. However, we have marked this issue as the highest priority and are actively working toward a solution.
While we are still investigating, this issue appears to be related to extreme anti-scraping measures Google recently implemented (see #2629). We were able to put a temporary solution in place to restore service on the 17th, but as we work towards a more permanent, stable resolution.
We will continue to post updates here as we have them, thank you both for your patience and understanding while we work through this.
Thanks. Appreciate the context!
Our engineers have developed a fix for this. We're still monitoring to ensure everything is working as expected. We'll follow up again once it's confirmed the fix is stable.
@Zack-Xb @miguelrios for visibility
Thank you for the quick work on this. It would be great to discuss efforts in mitigating any future events and if you have any more information on google anti-scraping efforts please do share.
Thank you for the quick work on this. It would be great to discuss efforts in mitigating any future events and if you have any more information on google anti-scraping efforts please do share.
Agreed. These things happen but the more information we have the better we can navigate!
Here's an update:
Our engineers have developed a solution that should have restored service.
We're still monitoring to ensure everything is working as expected for all of our APIs. We'll follow up again once we've confirmed the fix is stable.
All of our APIs seem to be working as expected following the fix.
@renatocuriel @miguelrios for more background, there were several factors that contributed to the issue. Google changed their approach to cookies, which required us to update our approach in response. At the same time, we also dealt with performance degradation from a few of our proxy providers, and a significant increase in volume from one of our biggest customers.
We are working to increase our available resources, ensure better performance across all proxy providers, and refine our handling of cookies. This should improve the stability of our services and help to prevent downtime in the future.
If you have any other questions, please reach out to [email protected].
Reopening this as we're down again.
Some reports: (May be some duplicates from yesterday)
Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom
We're back online, but seeing some elevated response times. We're investigating this.
More reports:
Intercom Intercom Intercom Front Intercom Intercom Front Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Intercom Front
Update: Response times are increasing again. We apologize for the inconvenience. We are working on stabilizing them as soon as possible.
Update: We have deployed a fix, and response times have been decreasing. We'll continue monitoring for any issues.
I'm closing this issue, as response times have been stable over the past month or so. Feel free to reach out to support any time with any questions or concerns.