surge icon indicating copy to clipboard operation
surge copied to clipboard

surge.sh seems to be down?

Open prevail90 opened this issue 1 year ago • 41 comments

is anyone else seeing this as well?

prevail90 avatar Sep 24 '23 02:09 prevail90

Me too. I always get a 503 error even on the help page.

Tennisatw avatar Sep 24 '23 21:09 Tennisatw

Hi @sintaxi. Should we consider surge.sh to be abandoned? It's an amazing service but it's been very unreliable lately, here's the last 30 days:

image

Thanks!

joanniclaborde avatar Sep 27 '23 14:09 joanniclaborde

@joanniclaborde Every year or two surge hits a new scaling issue that has to be worked through. The downtime above is for our Toronto datacenter only. For some reason (that is not yet understood) in that datacenter we are having a cache server that is crashing when it attempts to snapshot its data. It can be valuable to observe the problem and come up with solutions that make the system more fault tolerant. Perhaps I haven't address this issue with enough urgency and my poor communication doesn't help either. For that Im sorry.

sintaxi avatar Sep 27 '23 15:09 sintaxi

@sintaxi Thanks for the quick update, it's appreciated! Do you have an approximate date when this issue should be fixed?

joanniclaborde avatar Sep 27 '23 17:09 joanniclaborde

spinning up new edgenodes now. should be fixed within the day.

sintaxi avatar Sep 27 '23 21:09 sintaxi

That's amazing, thanks! I'll keep you posted if I notice any more downtime.

joanniclaborde avatar Sep 28 '23 12:09 joanniclaborde

Hi all. Still seeing a 503 when I visit surge.sh unfortunately. Any updates on when this will be more completely resolved?

emenel avatar Sep 29 '23 13:09 emenel

Fixes still in the works.

sintaxi avatar Sep 29 '23 17:09 sintaxi

All my apps are down :( 503 Service Unavailable

aogaili avatar Sep 29 '23 22:09 aogaili

Seems to be back up! I hope there is some protection against this kind of disturbance, it rarely happens but it hits hard when it does.

aogaili avatar Sep 29 '23 22:09 aogaili

UPDATE: New edgenodes have been stood up in the Toronto location. Doing some QA before re-routing traffic.

sintaxi avatar Sep 30 '23 18:09 sintaxi

Thank you so much @sintaxi , honestly, surge has superior UX, the simplicity and functionality are just too good, and it has been my go-to.

aogaili avatar Sep 30 '23 19:09 aogaili

New Toronto Edgenode has been running flawlessly for 72h. Also spun up a new edgenode in London which has been running for 48h.

Going to close this ticket. Thank you all for the help and support.

sintaxi avatar Oct 04 '23 19:10 sintaxi

Wonderful, much appreciated 🙏

aogaili avatar Oct 05 '23 02:10 aogaili

Hi there, I am still getting 502 Bad gateway errors for my sites as well. Any updates?

kevinta893 avatar Oct 15 '23 15:10 kevinta893

Could be specific to your deployment or region, don't see the issue here.

On Sun, Oct 15, 2023, 11:14 a.m. kevinta893 @.***> wrote:

Hi there, I am still getting 502 Bad gateway errors for my sites as well. Any updates?

— Reply to this email directly, view it on GitHub https://github.com/sintaxi/surge/issues/513#issuecomment-1763420441, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAMZAK5PJJUY2PX4BCX3JTLX7P4UJANCNFSM6AAAAAA5ETT2JQ . You are receiving this because you commented.Message ID: @.***>

aogaili avatar Oct 15 '23 15:10 aogaili

Still happening here too, here's the last 24h: image

And the last 7 days: image

joanniclaborde avatar Oct 15 '23 23:10 joanniclaborde

I have no issues during deployment, but visiting my websites is hit or miss. Sometimes my browser will grab a few files and 50X error. Sometimes I'm lucky and the whole site loads in time before another error.

I confirmed with various users of my sites across the globe that they too are having the same issues.

kevinta893 avatar Oct 16 '23 00:10 kevinta893

I can confirm there has been issues with a couple of our North America locations. Changes have been made and I think we are through the worst of it. Please keep me posted with your findings for the coming week.

thanks, Brock

sintaxi avatar Oct 16 '23 06:10 sintaxi

Im reopening this ticket until stability is confirmed by you all.

sintaxi avatar Oct 16 '23 06:10 sintaxi

Im reopening this ticket until stability is confirmed by you all.

I was seeing 502 errors across all of my deployments for a few weeks (I'm based in Australia, if that makes a difference), but they're all fixed now and everything is working as expected. Thanks for your hard work!

KeyboardSounds avatar Oct 23 '23 05:10 KeyboardSounds

The last incident was on 2023-10-20 for me.

joanniclaborde avatar Oct 23 '23 12:10 joanniclaborde

Seems stable for me for now.

kevinta893 avatar Oct 24 '23 00:10 kevinta893

All subdomains having issues right now for me. Updates @sintaxi ?

ultracodez avatar Nov 13 '23 17:11 ultracodez

Is the server down?

ronskie69 avatar Nov 13 '23 21:11 ronskie69

it's now working...

ronskie69 avatar Nov 14 '23 01:11 ronskie69

Now getting a 504 Gateway Time-out: "The server didn't respond in time."

ultracodez avatar Nov 14 '23 16:11 ultracodez

Same here and it was down yesterday for me as well. Had sent an email to support but no response. I wish they would at least post outages somewhere.

wkande avatar Nov 14 '23 20:11 wkande

Seems resolved now...

ultracodez avatar Nov 15 '23 20:11 ultracodez

Yes but sadly Surge is not saying much.

UPDATE: not five minutes after posting this comment I got an update from Surge:

Apologies for not getting back to you sooner. We have been fighting off a wave of phishing campaigns on our platform and it has lead to our SFO datacenter being temporarily out of service. We are routing the traffic to our Toronto datacenter until we get the issue resolved.

The 40 second delay is caused from the deployment server trying to verify the deployment to the SFO location and timing out. We will look into improving that experience.

So I spoke too soon.

wkande avatar Nov 15 '23 22:11 wkande