RWKV-LM
RWKV-LM copied to clipboard
Radeon Open Compute support
There are many users with AMD graphics cards that want to train this model in a GPU accelerated manner. Radeon Open Compute is AMD's equivalent to CUDA (the relevant component in Radeon Open Compute is called HIP).
- [ ] Attempt to HIPify the codebase
- [ ] Make the HIP port optimised for full performance
Cool. Let me know if you will work on it
Here is AMD Ubuntu 22.04 GPU guide https://github.com/BlinkDL/ChatRWKV/issues/15
Cool, waiting for it.
subtask 2 is not complete, should be reopened