RWKV-LM icon indicating copy to clipboard operation
RWKV-LM copied to clipboard

Published 20 hours ago • verified publisher icon BlinkDL

Meet in the middle type of training

Open Lundez opened this issue 1 year ago • 0 comments

It would be interesting to see if the new paper from Microsoft (https://arxiv.org/pdf/2303.07295.pdf) would have the same positive impact for RWKV. I don't see why not.

Is this something in the pipeline?

Lundez avatar Mar 21 '23 19:03 Lundez