alpaca-lora icon indicating copy to clipboard operation
alpaca-lora copied to clipboard

Published 20 hours ago • verified publisher icon tloen

accelerate the processing of dataset

Open eggqq007 opened this issue 1 year ago • 1 comments

a regular modern cpu may has 16 cores or above.

eggqq007 avatar Apr 03 '23 07:04 eggqq007

Great suggestion!

I'd like this to be an extra param, or be auto computed from number of cores / number of gpus. When running with DDP for instance, we don't want each process to use all cores.

AngainorDev avatar Apr 03 '23 09:04 AngainorDev