Elias Frantar

Results 11 comments of Elias Frantar

Hi, Marlin currently does not support BF16 inputs (though in many cases you can just convert your BF16 model to FP16). These require slightly different GPU instructions as well as...