composer icon indicating copy to clipboard operation
composer copied to clipboard

A Better Progress Bar

Open hanlint opened this issue 3 years ago • 3 comments

cc: @siriuslee @A-Jacobson @Landanjs

hanlint avatar Feb 02 '22 21:02 hanlint

Can you elaborate?

ravi-mosaicml avatar Feb 08 '22 18:02 ravi-mosaicml

I'll do my best.

TLDR: the progress bar should at least tell us total training time and model metrics at a glance.

our current progress bar looks like this: Screen Shot 2022-02-11 at 1 36 56 AM

There are a few things lacking with this setup:

  1. It could use an overall progress bar so the user can get an estimate of total training time without doing some mental math.

  2. It doesn't log enough metrics, I had a hard time logging anything except validation accuracy. Which isn't really enough to tell if your model is improving.

the fastai progress bar is sort of the extreme example of this, they render tables of training metrics as they train. Screen Shot 2022-02-11 at 1 51 13 AM

Their library can even render plots during training though i dont know if we need to go that far. https://github.com/fastai/fastprogress

A-Jacobson avatar Feb 11 '22 09:02 A-Jacobson

Austin provided great points for improvement!

For me specifically, displaying the learning rate would be helpful to debug if it is increasing/decreasing at the expected times. Likely, it would be helpful to visualize most callback monitored metrics on the progress bar. Providing visualizations/table are bonuses for improving debugging

Landanjs avatar Feb 14 '22 22:02 Landanjs

Closing. Tracking elsewhere as low pri

mvpatel2000 avatar Jun 22 '23 21:06 mvpatel2000