satellite icon indicating copy to clipboard operation
satellite copied to clipboard

Slave state.json metrics on influxdb

Open zorel opened this issue 9 years ago • 6 comments

Hello.

I've managed to install satellite on my mesos cluster. Reimann is pushing data in a local influxdb for grafana, but I'd like to push slave state.json.

My riemann config is very simple:

(def inflxdb (graphite {:host "master1" :port 2003}))
(streams
  inflxdb
)

My slave config:

(def mesos-work-dir "/tmp/mesos")
(def settings
  {:satellites [{:host "master1"}]
  :service "mesos/slave/"
)

In influxdb, I see localhost.mesos/* with master info, and the consolidated informations for my frameworks, but no slave informations. Is it possible?

Thanks.

zorel avatar Sep 24 '15 14:09 zorel

Hey @zorel sorry for the delay! Currently none of the recipes turn the slave's state.json into an event stream. We can make this into a recipe, but if you want to do that right now, I would make a test that polls the state.json and produces a list of riemann events, the kv pairs in the state.json. Let me know if this answers your question!

sabraham avatar Sep 28 '15 17:09 sabraham

Hello, thanks for the answer. I'm not familiar with either Satellite, Reimann or clojure, so the cleaner solution will be ok for me.

I guess I will have to take a look at clojure & reimann to see how I can write my own recipes btw.

zorel avatar Oct 01 '15 08:10 zorel

Happy to help with this! We could schedule some time to chat over irc to go over how to make a test. If that's something you'd find helpful, shoot me an email at [email protected]

sabraham avatar Oct 01 '15 11:10 sabraham

I'd be happy to turn this into a recipe. Still sound like a good idea to you @sabraham ?

mforsyth avatar Nov 18 '15 15:11 mforsyth

Absolutely a good idea - note that similar work was done in cache-state https://github.com/twosigma/satellite/blob/master/satellite-slave/src/satellite_slave/mesos/recipes.clj#L21

sabraham avatar Nov 18 '15 17:11 sabraham

Thanks @sabraham

mforsyth avatar Nov 18 '15 17:11 mforsyth