composer
composer copied to clipboard
A Better Progress Bar
cc: @siriuslee @A-Jacobson @Landanjs
Can you elaborate?
I'll do my best.
TLDR: the progress bar should at least tell us total training time and model metrics at a glance.
our current progress bar looks like this:
There are a few things lacking with this setup:
-
It could use an overall progress bar so the user can get an estimate of total training time without doing some mental math.
-
It doesn't log enough metrics, I had a hard time logging anything except validation accuracy. Which isn't really enough to tell if your model is improving.
the fastai progress bar is sort of the extreme example of this, they render tables of training metrics as they train.
Their library can even render plots during training though i dont know if we need to go that far. https://github.com/fastai/fastprogress
Austin provided great points for improvement!
For me specifically, displaying the learning rate would be helpful to debug if it is increasing/decreasing at the expected times. Likely, it would be helpful to visualize most callback monitored metrics on the progress bar. Providing visualizations/table are bonuses for improving debugging
Closing. Tracking elsewhere as low pri