logsniffer icon indicating copy to clipboard operation
logsniffer copied to clipboard

[question] How to stream remote logs?

Open archenroot opened this issue 7 years ago • 2 comments

Hi community,

I would like to tail remote files. Now, I can implement SSH based wrapper for log source, but not sure about the performance especially with increasing number of files to be captured...by adopting: https://github.com/lucastheisen/jsch-nio

Another idea is to implement agent based stuff via https://github.com/OpenHFT/Chronicle-Queue.

Please any comments or better proposals are welcomed.

archenroot avatar Aug 20 '17 16:08 archenroot

Ok, I decided to simplify things and under the terms that I don't have hundreds of servers to monitor, I will go with SSHFS.

SSHFS could be quite slow, so for best performance I will:

  • patch all servers with https://www.psc.edu/hpn-ssh.
  • mounting with options Ciphers=arcfour(fastest cipher) -o Compression=no (no compression)

archenroot avatar Aug 21 '17 19:08 archenroot

Looking forward for your submission

mbok avatar Aug 21 '17 21:08 mbok