hsb1995

Have you solved this problem? I have encountered the same problem and am still solving it. I would like to consult with you on how to resolve the issue? I...

Have you also tried the Qlora option command ? ---- Replied Message ---- | From | ***@***.***> | | Date | 4/9/2024 09:58 | | To | ***@***.***> | |...

 I just tested that files with small weights can be computed in parallel, but files with large weights cannot. This indicates that it is not an issue with our...

> Hi @hsb1995 , > > Yes, 7B is working fine without an issue with the parallel process. > > Have you also tried the Qlora option command? => Yes,...

  The command he mentioned in the article requires 128G-CPU, which is currently the case with me. Is it related to this? Or can you take a look at...

@sanipanwala

Is this a bit awkward for me? Is it because of this reason that the operation did not succeed? @sanipanwala

I feel that my failure was caused by the CPU, and I tried other commands but still couldn't succeed. @johnowhitaker But it's strange why you didn't succeed either. Because all...

  Why does the pre training weight after running decrease by a lot of files? How can I use the trained files for downstream tasks? Do you know? I...

@jshilong 麻烦教授解决下，麻烦您！