nsqadmin: grafana & prometheus support

[nordicdyno]

Please, consider support of grafana's graphs embeding. I would like to see end-to-end solution for nsq and prometheus + grafana integraton. That do you think?

[mreiferson]

You mean specifically for nsqadmin, right?

If so, then yes, I think it would be useful to support the industry standard as it evolves (which was graphite back in early 2012).

[mreiferson]

P.S. this is an official "help wanted", if this is something you or others want to see, it's going to need to be contributed!

:heart:

[nordicdyno]

You mean specifically for nsqadmin, right?

Yeah exactly!

if this is something you or others want to see, it's going to need to be contributed

Thank you very much! I hope I will find some time and start prototyping solution. If anybody could help it would be great!

[nordicdyno]

FYI: These guys @life360 already using Prometheus with NSQ. There is an article on Prometheus blog https://prometheus.io/blog/2016/03/23/interview-with-life360/ Maybe they have some thoughts and ideas about implementation details

[Dnile]

Hey there, daniel from life360 here, i was interviewed for that blog post :)

would love to help in any way

[Dnile]

basically we use this: https://github.com/life360/nsq_exporter

and with a chef recipe, we register it in consul wherever an nsqd is present. we have prometheus->consul setup and then its just matter of configuring the job.

the dashboards are set to gather the proper metrics, which you can find here:

https://github.com/life360/prometheus-grafana-dashboards/blob/master/nsq/nsq-all-topics.json

[mreiferson]

@Dnile thanks! What about nsqadmin though? I take it you just ran with the built-in graphs disabled?

[Dnile]

@mreiferson sort of, we...ignore the missing images :)

so i thought about this a little bit today, i think the easiest way would be to query prometheus for pre rendered graphs in png.

not sure if its supported through the api though, have to check that option.

[mreiferson]

so i thought about this a little bit today, i think the easiest way would be to query prometheus for pre rendered graphs in png.

Yes, that's what we do for graphite.

[nfisher]

Could see using OpenCensus for this which provides prometheus end-points.

Orthogonal to this issue but It also provides an abstraction for a number of distributed tracing systems: Stackdriver, zipkin, and Jaegar to name a few. Can open a new issue for that.

[caozhipan]

I write a nsq prometheus exporter , it works well, and it provide a grafana nsq stats dashboard https://github.com/caozhipan/nsq-prometheus-exporter

[LordNoteworthy]

I have seen many exporters for NSQ for prometheus, which ones do you guys use currently? :

• https://github.com/caozhipan/nsq-prometheus-exporter (last commit 9 months ago)
• https://github.com/team-centric-software/nsq-prometheus-exporter (last commit 17 months ago)
• https://github.com/lovoo/nsq_exporter (3 years ago)

[acondrat]

I have seen many exporters for NSQ for prometheus, which ones do you guys use currently? :

Was looking for the same thing and ended up using the statsd integration + statsd-exporter

[JensRantil]

I have seen many exporters for NSQ for prometheus, which ones do you guys use currently? :

• https://github.com/caozhipan/nsq-prometheus-exporter (last commit 9 months ago)
• https://github.com/team-centric-software/nsq-prometheus-exporter (last commit 17 months ago)
• https://github.com/lovoo/nsq_exporter (3 years ago)

I'd recommend also looking at the number of stars on Github. That makes https://github.com/lovoo/nsq_exporter a clear winner.

[eddycharly]

the dashboards are set to gather the proper metrics, which you can find here:

https://github.com/life360/prometheus-grafana-dashboards/blob/master/nsq/nsq-all-topics.json

@Dnile it looks like the dashboard is not in github anymore, do you happen to have a copy of it and would be ok to share it please ?