FineTuningLLMs

FineTuningLLMs copied to clipboard

Chapter 0 - RuntimeError: chunk expects at least a 1-dimensional tensor

2

Got `RuntimeError: chunk expects at least a 1-dimensional tensor` on `trainer.train()` in self-hosted Conda Jupyter environment:  ``` absl-py 2.2.2 Abseil Python Common Libraries, se... accelerate 1.1.1 Accelerate aiohappyeyeballs 2.6.1...

mazurkin

Chapter 4 is poorly written

2

bigmisspanda

RAFT/DPO/RLHF ?

4

@dvgodoy Sorry couldn't find the discussions sections.. Can you also provide some guides on how you would do RAFT and also RLHF? there are tons of material around them on...

vahidreza