fms-fsdp icon indicating copy to clipboard operation
fms-fsdp copied to clipboard

Published 20 hours ago • verified publisher icon foundation-model-stack

The default model variant is 7b but it is not supported.

Open htang2012 opened this issue 8 months ago • 2 comments

the default model variant is "7b": https://github.com/foundation-model-stack/fms-fsdp/blob/65b0ea670fa375bb0f7f6a285e7229bb96ebdd0f/fms_fsdp/config/training.py#L8

but it is not in the supported white list: https://github.com/foundation-model-stack/fms-fsdp/blob/65b0ea670fa375bb0f7f6a285e7229bb96ebdd0f/fms_fsdp/utils/config_utils.py#L25

htang2012 avatar Jun 11 '24 16:06 htang2012