exo icon indicating copy to clipboard operation
exo copied to clipboard
Published 1 month ago • verified publisher icon exo-explore

Emit statistics

Open AlexCheema opened this issue 1 year ago • 1 comments

  • tokens / sec IMG_0077
  • memory usage
  • gpu utilisation
  • bytes sent / received
  • num errors
  • MFU (great metric. see e.g. https://x.com/tinygrad/status/1814519105346810038)

AlexCheema avatar Jul 17 '24 17:07 AlexCheema

Should be easy to add this to opaque status, since that can hold arbitrary values and already gets broadcast to all nodes.

AlexCheema avatar Jul 21 '24 05:07 AlexCheema