RWKV-LM icon indicating copy to clipboard operation
RWKV-LM copied to clipboard

Published 20 hours ago • verified publisher icon BlinkDL

complex rotary memory

Open harrisonvanderbyl opened this issue 9 months ago • 0 comments

Complex rotary memory. Seems to give a boost to model learning and smaller test models appear to grok information easier

harrisonvanderbyl avatar Sep 15 '23 21:09 harrisonvanderbyl