Support automated early stopping

[ab93]

Summary

Early stopping can help reduce overfitting of the models, and an automated way of doing that will be really helpful.

---

Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.