llkn-2

segmentation fault when calling parafac()

10

Hi, I encountered the same error as @ #16 , while I used numpy backen. The version of **numpy** is 1.15.1 and the version of **tensorly** is 0.4.2. Any solution...

[Feature] Pipeline Parallelization of Different Stages in RLHF

4

## Motivation The RLHF process can be divided into three stages: Generation, Forward, and Train. In the Generation stage, responses are generated using the vLLM. During the Forward stage, the...