vllm icon indicating copy to clipboard operation
vllm copied to clipboard
verified publisher icon vllm-project

MPS backend (Metal kernels) support (Apple, M1, M2)

Open dosier opened this issue 2 years ago • 0 comments

Do you know if support for this is planned? I may be interested in writing the custom metal kernels.

dosier avatar Jun 22 '23 20:06 dosier