stanford_alpaca icon indicating copy to clipboard operation
stanford_alpaca copied to clipboard

Published 20 hours ago • verified publisher icon tatsu-lab

NotImplementedError: offload_to_cpu=True and NO_SHARD is not supported yet

Open mechigonft opened this issue 2 years ago • 1 comments

I am using a single GPU(A10) to run Bloom-560m model fine-tune, error, how to solve? I found similar problems in other projects, but I didn't know how to solve the problems in alpaca https://github.com/Alpha-VLLM/LLaMA2-Accessory/issues/76

mechigonft avatar Nov 28 '23 08:11 mechigonft

When saving the model checkpoint, an error occurred, which should be a problem with fsdb. My Python version is 3.8.16 Can I solve this problem by deleting the "--fsdp "full_shard auto_wrap"

--fsdp_transformer_layer_cls_to_wrap 'BloomBlock' " from the bash script?

mechigonft avatar Nov 28 '23 08:11 mechigonft