rain icon indicating copy to clipboard operation
rain copied to clipboard
verified publisher icon substantic

Improved live and post-mortem monitoring

Open gavento opened this issue 8 years ago • 4 comments

Improve the online monitoring to:

  • Show session list summary with more info
  • Show more statistics and graphs, e.g. aggregation by task type or group (proposed in #32)
  • Show a timeline by groups or with significant (all or e.g. named?) events.
  • Only display the dependency graph optionally and for reasonably small graphs
    • As a future improvement, we could display the dependency graph of groups, clusters, task types etc.)
  • See the full details of every task and object (on demand)
  • Examine history of the events in some way (a timeline may be enough)
  • Do all of this for finished and closed sessions via re-running the server with the sa

This depends on a streaming API (#11) and may require a complete UI framework.

gavento avatar Apr 13 '18 15:04 gavento

I would also note that, maybe the protocol will be changed later, but type of events are more or less fixed and do not see any major flow in design. However, the user interface (JS side) is mostly proof-of-concept, so if someone has feeling that it needs a major revamp then I (as the author of the current dashboard) have nothing against it. Let me also remind that setup for developing dashboard is described in docs.

spirali avatar Apr 18 '18 18:04 spirali

I would like to help here. I believe there will be a bunch of PR's to get the features listed here. I could start with the session summary. Any special information, which should be included there? I believe something like session duration, processed tasks, status, right?

Trojan295 avatar Jul 13 '18 13:07 Trojan295

@Trojan295 Great! You are right, basic summaries like task durations, number of submits, IP of client, number of tasks/object are welcome. The current dashboard now supports only the chart of unprocessed tasks in time.

It would be also nice to separate the session page into "summary" and "detail". The full task-object dependency graph for large graphs is slow and usually not useful, so it would be nice to show summary of session without showing this graph.

spirali avatar Jul 13 '18 19:07 spirali

We have made some progress with Dashboard. @Kobzol migrate whole dashboard into TypeScript and we have added task inspector and basic task summary.

spirali avatar Aug 09 '18 13:08 spirali