RWKV-LM icon indicating copy to clipboard operation
RWKV-LM copied to clipboard

Published 20 hours ago • verified publisher icon BlinkDL

RWKV on TPU?

Open leejason opened this issue 2 years ago • 1 comments

Is it possible to train RWKV on TPU? If not, what would be needed?

leejason avatar Mar 27 '23 02:03 leejason

On Nvidia GPUs you need a CUDA kernel for efficient training. Wonder if we can do similar things for TPUs

BlinkDL avatar Mar 29 '23 18:03 BlinkDL