worker icon indicating copy to clipboard operation
worker copied to clipboard

Added Redis Cache support for worker reports

Open paritoshpr opened this issue 4 years ago • 8 comments

Fixes #

Proposed Changes

  • Supports Redis as an alternate and in addition to Kafka for acquiring worker logs
  • Supports cache expiry time with a default of twice the manager_check_in_time
  • Supports Redis AUTH mechanism as well

paritoshpr avatar Sep 10 '21 17:09 paritoshpr

Hello @naorlivne I have incorporated the changes you have requested. Please take a look and let me know what you think.

paritoshpr avatar Sep 10 '21 21:09 paritoshpr

I removed the ip address get feature. I agree with you at this point its moot. In the use case we have, I wanted to force the user to add the IP address since we wanted to create a reporting tool where the IP address is required. The fqdn method sometimes does not resolve to the correct host name and provides the container id i think.

paritoshpr avatar Sep 10 '21 22:09 paritoshpr

Plus I have also updated the documentation

paritoshpr avatar Sep 10 '21 22:09 paritoshpr

Oh youre right! I did not realize there is a backed integration of Kafka. Super cool! Honestly, nebula has really helped me a lot. So I am trying to give back in whatever way I can. I would be happy to make changes there. Give me a few days. I am swamped right now. Ditto for the document changes.

paritoshpr avatar Sep 11 '21 21:09 paritoshpr

Thanks for giving back, it's what FOSS is built on after all, If possible can you maybe also give a bit of info on your Nebula usecase? I'm always curious to see how people are using it.

naorlivne avatar Sep 12 '21 07:09 naorlivne

We are actually trying to build a decentralized analytics framework in our lab at Georgia Tech. We needed a way to push analytics to the edge and thats when I came across Nebula!

paritoshpr avatar Sep 12 '21 21:09 paritoshpr

Hi @paritoshpr ,

Wanted to see how is it going, both regarding this ticket and your overall Nebula use?

naorlivne avatar Oct 11 '21 14:10 naorlivne

Hey @naorlivne Apologies. I havent been able to get to these fixes. Hopefully I'll be able to squeeze some time at the end of the month. Apart from that Nebula has been running great!

paritoshpr avatar Oct 11 '21 21:10 paritoshpr