LLMs-from-scratch
LLMs-from-scratch copied to clipboard
Issue 1: Typo in `appendix_d.py` comment
Body:
In appendix_d.py, there's a typo in the comment:
if global_step >= warmup_steps: # the book originally used global_step > warmup_steps, which lead to a skipped clipping step after warmup
"lead" should be "led".