azure-signalr icon indicating copy to clipboard operation
azure-signalr copied to clipboard

Azure SignalR autoscale

Open shankarmohannamakkal opened this issue 5 years ago • 22 comments

Is your feature request related to a problem? Please describe.

I am trying to identify a solution for Azure SignalR auto-scaling

Describe the solution you'd like

SignalR service currently only supports 1000 concurrent connections per service instance per unit. If the number of concurrent SignalR connections exceed 1000, the service instances unit will have to be increased manually, and reduced manually as the users decrease.

Looking for the suitable solution to auto-scale (scale up and scale down) the SignalR service instances based on the demand.

Please give suggestions or ideas about this. Thanks.

shankarmohannamakkal avatar Nov 03 '20 11:11 shankarmohannamakkal

Here is a guidance about how to scale an Azure SignalR Service instance. Is this what you need?

yjin81 avatar Nov 17 '20 07:11 yjin81

I am looking for auto-scale up and down based on the user connections.

shankarmohannamakkal avatar Nov 23 '20 11:11 shankarmohannamakkal

Currently, scale-in/out will cause client connections drop, so we won't give auto-scale. But we are working on smooth scale in/out, when it done, we will provide auto-scale.

vwxyzh avatar Dec 03 '20 03:12 vwxyzh

Currently, scale-in/out will cause client connections drop, so we won't give auto-scale. But we are working on smooth scale in/out, when it done, we will provide auto-scale.

Ok

shankarmohannamakkal avatar Dec 17 '20 11:12 shankarmohannamakkal

We are also very interested in auto-scaling Azure SigR and understand the issue you face. With that said, is it actively being worked on and/or on any sort of roadmap?

mmulhearn avatar Jan 15 '21 14:01 mmulhearn

@mmulhearn @shankarmohannamakkal We've already worked on it and overcome some critical issues. I can't give the ETA of auto-scaling but we can provide a smoother (no connection drops) scaling experience first.

zackliu avatar Apr 27 '21 09:04 zackliu

@zackliu when is that expected to release?

mmulhearn avatar Apr 27 '21 14:04 mmulhearn

If you want to try the new scaling experience, please create new resources in EastUS or WestUS2 and have a try. It's still in preview in limited regions and haven't been announced. In the new scaling experience, the scaling is very fast even from unit 1 -> 100. Connections won't drop immediately during scaling. We can guarantee that we won't drop connections when you're in high server load. So if your service is reaching limit and scale up, the experience should be better. But if you're in very low server load, you may meet connection drops. The experience may change in future. We will try our best to avoid any connection drops. Welcome any feedbacks on the new scaling experience.

zackliu avatar Apr 28 '21 04:04 zackliu

@zackliu Tried creating a new SignalR resource in EastUS. Is there an option for switch on the auto-scaling or by default this auto-scale will work?

shankarmohannamakkal avatar Apr 28 '21 08:04 shankarmohannamakkal

@shankarmohannamakkal No, there's no auto scaling now. What we have currently is a new scaling experience, which is smoother and faster. The auto scaling must base on a smoother scaling experience. Thus, we're testing the new scaling experience and add auto scaling feature once it's mature.

zackliu avatar Apr 28 '21 14:04 zackliu

Any updates on this? How is the preview going? any plans for GA?

hora7ce avatar Jul 12 '21 12:07 hora7ce

@hora7ce It's internal testing. We're integrating with Azure Autoscale and you can have a consistent autoscale experience among Azure. For the public preview date, I will keep updating here once I can give that.

zackliu avatar Jul 12 '21 15:07 zackliu

By the way, for the new scaling experience I mentioned before, we've enabled in all regions. For all the newly created resource, scaling is seamless. Which means no connection drop during scaling.

zackliu avatar Jul 12 '21 15:07 zackliu

By the way, for the new scaling experience I mentioned before, we've enabled in all regions. For all the newly created resource, scaling is seamless. Which means no connection drop during scaling.

Is re-creating our existing SignalR service the only way to get the smoother experience? If so we will need to plan a maintenance window for that. An upgrade script would be a better solution. Any idea on that?

wouterjanssens avatar Aug 24 '21 06:08 wouterjanssens

by new scaling experience you mean this? image Any news on integration with Azure Autoscale ? dates for GA or public preview at least

hora7ce avatar Oct 20 '21 06:10 hora7ce

@hora7ce It's internal testing. We're integrating with Azure Autoscale and you can have a consistent autoscale experience among Azure. For the public preview date, I will keep updating here once I can give that.

@hora7ce any updates on this? When is this expected to be in private or public preview?

tonycoelho avatar Nov 22 '21 03:11 tonycoelho

Q1 2022 is the estimated time for public preview.

zackliu avatar Nov 22 '21 03:11 zackliu

Hi, I wrote this solution https://dev.to/wilsonyesidriveracasas/auto-scaling-azure-signalr-units-4e94

WilsonYesidRiveraCasas avatar Jan 25 '22 04:01 WilsonYesidRiveraCasas

@zackliu I just noticed this article about the auto scaling setting, which is great news! However it mentions it's only available on the "Premium" pricing tier that is currently in public preview, but I can't find anything in the portal about switching to that tier, I only still see "Free" and "Standard".

https://docs.microsoft.com/en-us/azure/azure-signalr/signalr-howto-scale-autoscale

Was the doc released prematurely?

MarcusU avatar Feb 20 '22 00:02 MarcusU

@MarcusU , The free tier is limited, but there is a way to configure autoscaling in standard tier. https://dev.to/wilsonyesidriveracasas/auto-scaling-azure-signalr-units-4e94 It isn't a Microsoft official post, but, works.

WilsonYesidRiveraCasas avatar Feb 21 '22 13:02 WilsonYesidRiveraCasas

Premium tier has not public released yet. We're preparing for that. It's expected to be public in March.

zackliu avatar Feb 22 '22 04:02 zackliu

Azure SignalR is supporting autoscale in Premium Tier. Please refer to docs: https://docs.microsoft.com/en-us/azure/azure-signalr/signalr-howto-scale-autoscale Premium Tier: https://azure.microsoft.com/en-us/updates/public-preview-azure-signalr-service-premium-tier/

zackliu avatar Mar 24 '22 10:03 zackliu