DeepSeek-Coder-V2 icon indicating copy to clipboard operation
DeepSeek-Coder-V2 copied to clipboard
verified publisher icon deepseek-ai

What is the FSDP value for `fsdp_transformer_layer_cls_to_wrap`?

Open Metaspectral opened this issue 1 year ago • 0 comments

Hey there, Trying to fine-tune your model. What is the FSDP value for fsdp_transformer_layer_cls_to_wrap? Thanks!

Metaspectral avatar Aug 04 '24 05:08 Metaspectral