Hystrix icon indicating copy to clipboard operation
Hystrix copied to clipboard

hystrix.stream URI getting 503 MaxConcurrentConnections reached

Open rajanalagspann opened this issue 8 years ago • 8 comments

We are using Hystrix 1.5.9 frame in our application, we have setup the hystrix dashboard and hystrix turbine for monitoring.

We are observing lot of 503s for hystrix.stream url requests from turbine application to business application where the actual services are implemented with hystrix framework.

Anyone have idea how we can fix this.

Error 503 MaxConcurrentConnections reached: 5

HTTP ERROR 503

Problem accessing /hystrix.stream. Reason:

    MaxConcurrentConnections reached: 5

Powered by Jetty:// 9.4.0.v20161208

Could you please help how to resolve this.screen shot 2017-07-25 at 11 36 58 am

rajanalagspann avatar Jul 25 '17 21:07 rajanalagspann

So, 1. you can set the following property to increase the number of concurrent connections: hystrix.stream.maxConcurrentConnections

I'm not sure if that would fix your issue though. We had a similar issue when using websphere. What appserver are you using??

foobaar avatar Aug 01 '17 15:08 foobaar

We are using Jetty server, we will try this option

rajanalagspann avatar Aug 02 '17 00:08 rajanalagspann

Judging by the output on the screenshot there are no commands being reported which did lead to leaked connections (#1430) that was fixed in 1.5.9. I confirmed it fixed my issue which was presenting itself the same as you are describing. I would try upgrading to 1.5.12.

mattnelson avatar Aug 02 '17 15:08 mattnelson

Thanks for response, we will upgrading to 1.5.12, will update that worked for us or not

rajanalagspann avatar Aug 11 '17 19:08 rajanalagspann

@rajanalagspann out of interest, did the upgrade work for you? We are seeing the same issue on our site now

fatal-exception avatar Jan 30 '18 10:01 fatal-exception

@foobaar please help with - how to provide hystrix.stream.maxConcurrentConnections configuration in dropwizard application?

mauliktrapas avatar Nov 10 '22 16:11 mauliktrapas

好的,我已收到。

ThinkingMan007 avatar Nov 10 '22 16:11 ThinkingMan007

@mauliktrapas I had to do something like this: https://github.com/foobaar/Hystrix/blob/bb4be57d5cb2186bc37fdd7d460f2cbd991edbe9/hystrix-contrib/hystrix-metrics-event-stream/src/main/java/com/netflix/hystrix/contrib/metrics/eventstream/HystrixMetricsStreamServlet.java#L56

This was quite a few years ago now, i haven't kept up with this project.

foobaar avatar Nov 24 '22 02:11 foobaar