HeShiLie comments

Repositories
Issues
Comments

Results 2 comments of


                                            HeShiLie

OOM and slow tokenization after upgrade LLaMA-Factory

same problem

OOM and slow tokenization after upgrade LLaMA-Factory

> Could you mitigate this problem by deleting these lines? > > [LLaMA-Factory/src/llamafactory/cli.py](https://github.com/hiyouga/LLaMA-Factory/blob/2b66b4df43cfd8cdee5130e44270135113902569/src/llamafactory/cli.py#L157-L159) > > Lines 157 to 159 in [2b66b4d](/hiyouga/LLaMA-Factory/commit/2b66b4df43cfd8cdee5130e44270135113902569) > from multiprocessing import freeze_support > > freeze_support() I...