[Feature request] Add Gemma. Mixtral support from gpt-fast

[mikekgfb]

We should bring over Gemma and Mixtral support from gpt-fast.

@iseeyuan can you have a look at this, and identify somebody who might drive this? Thanks!

cc: @metascroy