ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

[moe] refactor routers and fix moe bugs with activation checkpoint

Open 1SAA opened this issue 1 year ago • 0 comments

  • refactor moe routers
  • fix moe bugs with activation checkpoint

1SAA avatar Sep 22 '22 09:09 1SAA