hyperqueue icon indicating copy to clipboard operation
hyperqueue copied to clipboard

Storing worker monitoring into binary log

Open spirali opened this issue 4 years ago • 2 comments

  • Add new type of block into binary stream (file_writer in stream/server/rpc.rs) that contains serialized JSON with monitoring data.
  • Modify reader (stream/reader/logfile.rs) tthat it is still able read stream

spirali avatar Sep 10 '21 14:09 spirali

I think that this is now superseded by the HQ server event log. @spirali?

Kobzol avatar Jan 24 '22 14:01 Kobzol

Probably yes. I still would like to have something like matching logs stdout/stderr with monitoring events (e.g. to analyse that a task uses only 1 cpu after writing "xyz" on stdout). My original idea was some kind of "fat log" but it can be also combination of more files. And it should be probably based on newer file structure.

So this issue is superseded in this particular implementation, but not as a general idea

spirali avatar Jan 24 '22 15:01 spirali