CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Support float16 on ARM CPUs with native float16 support

Open FlippFuzz opened this issue 1 year ago • 3 comments

From https://github.com/guillaumekln/faster-whisper/issues/65


Some CPUs such as ARM Neoverse-N1 (Oracle Cloud free tier) support FP16 computation. It would be nice to have this feature because there could be up to a 2x speedup in computation speed compared to float32.

I'm just creating the enhancement request and understand that there might not be a focus on this because it only applies to a small subset of CPUs.

FlippFuzz avatar Mar 30 '23 12:03 FlippFuzz