Vim icon indicating copy to clipboard operation
Vim copied to clipboard

Published 20 hours ago • verified publisher icon hustvl

Vim bf16 training

Open chokevin8 opened this issue 7 months ago • 0 comments

If anyone has done bf16 training on Vim, can you let me know your environment for CUDA version, pytorch, causal_conv1d, and mamba_ssm? I cannot seem to get the environment right for bf16 training without getting various errors. I'm currently using:

torch==2.1.1 torchvision==0.16.1 torchaudio==2.1.1 CUDA 11.8 causal_conv1d==1.1.1 mamba-ssm==1.2.0.post1

chokevin8 avatar Jul 17 '24 08:07 chokevin8