CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Published 20 hours ago • verified publisher icon OpenNMT

feat: add ruy sgemm implementation

Open ebraraktas opened this issue 5 months ago • 1 comments

This PR adds SGEMM implementation with RUY. This is already mentioned in faster-whisper repository.

I implemented this, because my experience with BLAS on Android was worse than this, and BLAS performance was not consistent (It sometimes takes too long). In addition, this requires no additional dependency and allows one to use ctranslate2 without BLAS.

ebraraktas avatar Jan 11 '24 15:01 ebraraktas