PowerInfer icon indicating copy to clipboard operation
PowerInfer copied to clipboard

Published 20 hours ago • verified publisher icon SJTU-IPADS

Mixtral MoE support?

Open nivibilla opened this issue 1 year ago • 3 comments

Prerequisites

Please answer the following questions for yourself before submitting an issue.

  • [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
  • [x] I carefully followed the README.md.
  • [x] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • [x] I reviewed the Discussions, and have a new bug or useful enhancement to share.

Feature Description

Support for Mixtral MoE

nivibilla avatar Dec 20 '23 03:12 nivibilla

https://github.com/SJTU-IPADS/PowerInfer/issues/13

mathieu-heyarctic avatar Dec 20 '23 17:12 mathieu-heyarctic

@mathieu-heyarctic https://github.com/SJTU-IPADS/PowerInfer/issues/13 is for Mistral, not Mixtral

BadisG avatar Dec 20 '23 17:12 BadisG

This would be OP

dRAT3 avatar Jan 09 '24 21:01 dRAT3