Lavender Jiang issues

Results 3 issues of


                                            Lavender Jiang

trl-peft example scripts not visible to public

The new [blog post](https://github.com/huggingface/blog/blob/main/trl-peft.md) for implementing LoRA + RLHF is great. Would appreciate if the example scripts are public! 3 scripts mentioned in the blog posts: [Script](https://github.com/lvwerra/trl/blob/peft-gpt-neox-20b/examples/sentiment/scripts/gpt-neox-20b_peft/s01_cm_finetune_peft_imdb.py) - Fine tuning...

get_lr depends on iteration but not step

[get_lr](https://github.com/Lightning-AI/lit-gpt/blob/01ae9d37ef464b90de2aa6d00df3c985c65cbc56/pretrain/redpajama.py#L308) depends on iteration (one forward and backward pass) but not step (one optimizer step). This could be a problem when we have gradient accumulation (where 1 step= n iterations)....

enhancement

requirement.txt future version

When I run `pip install requirements.txt`, I got the error `No matching distribution found for futures==3.2.0 (from -r requirements.txt (line 8))`. After I manually change the version to 3.1.1, it...