Foundation Model Stack

icon location United States of America icon location IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Results 1 repositories owned by Foundation Model Stack

fms-fsdp

83
Stars
15
Forks
Watchers

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

verified publisher icon foundation-model-stack