routed-attention topic
List
routed-attention repositories
mixture-of-attention
101
Stars
3
Forks
Watchers
Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
