guxuanjun comments

Repositories
Issues
Comments

Results 2 comments of


                                            guxuanjun

OOM and slow tokenization after upgrade LLaMA-Factory

I’ve encountered the same issue. Keeping all other conditions the same, the step "Running tokenizer on dataset" is much slower in version 0.9.4dev compared to 0.9.2dev — we’re talking about...

OOM and slow tokenization after upgrade LLaMA-Factory

> Could you mitigate this problem by deleting these lines? > > [LLaMA-Factory/src/llamafactory/cli.py](https://github.com/hiyouga/LLaMA-Factory/blob/2b66b4df43cfd8cdee5130e44270135113902569/src/llamafactory/cli.py#L157-L159) > > Lines 157 to 159 in [2b66b4d](/hiyouga/LLaMA-Factory/commit/2b66b4df43cfd8cdee5130e44270135113902569) > > from multiprocessing import freeze_support > > freeze_support()...