LongChat icon indicating copy to clipboard operation
LongChat copied to clipboard

Published 20 hours ago • verified publisher icon DachengLi1

Hi, using xformers monkey patch training llama2 got loss explosion

Open lucasjinreal opened this issue 2 years ago • 0 comments

By using xformers to train llama2, the loss are explosion, do u know why? On V100 only

lucasjinreal avatar Aug 02 '23 06:08 lucasjinreal