XNNPACK icon indicating copy to clipboard operation
XNNPACK copied to clipboard

Plans for ARM SME support?

Open UsmanNadeem opened this issue 1 year ago • 2 comments

I recently saw https://github.com/google/XNNPACK/pull/7061 which adds sme to xnn_hardware_config.

Are there any plans for adding SME support? If so, then which kernels/operations are being prioritized for this?

Thanks

UsmanNadeem avatar Sep 18 '24 19:09 UsmanNadeem

SME is mainly interesting for its matrix multiply, which is GEMM and IGEMM for all datatypes. Hardware doesnt really exist yet, except maybe Apple M4, so when macOS supports SME it may be feasible to explore.

fbarchard avatar Sep 23 '24 18:09 fbarchard

Para fijar un clip, manténlo presionado. Después de una hora, se borrarán todos los clips que no estén fijados.

Lomasuno avatar Sep 30 '24 09:09 Lomasuno

F32 SME support is added in https://github.com/google/XNNPACK/pull/7260

Support for other types will come in the next weeks/months

alankelly avatar Oct 23 '24 13:10 alankelly