mlx-examples icon indicating copy to clipboard operation
mlx-examples copied to clipboard

Published 20 hours ago • verified publisher icon ml-explore

Integrate RWKV V5 into MLx's Model Roster

Open umuthopeyildirim opened this issue 1 year ago • 3 comments

I'm interested in integrating RWKV v5 with MLX. Notably, RWKV uses CUDA as its kernel. I want to work on this to learn and any guidance on this process would be awesome.

umuthopeyildirim avatar Feb 08 '24 07:02 umuthopeyildirim

This version doesn't require CUDA. I'll start by porting this over and check how mlx manages it.

umuthopeyildirim avatar Feb 08 '24 10:02 umuthopeyildirim

That sounds awesome, let us know how it goes!

awni avatar Feb 08 '24 14:02 awni

Bump! Any chance of rwkv6 (Finch)?

p-i- avatar Apr 18 '24 12:04 p-i-