Jaeger M

Very poor output quality

55

I have noticed that while it massively increases the inference speed, it massively decreases the quality of the outputs, instruct models become very obstinate and give completely irrelevant responses, words...

[Bug]: 1.20.1 dungeon generation freezes

1

### What happened? Basically, there's a slight chance every time I go through a door in a dungeon to go to another part of the dungeon, it just freezes in...

Please add Phi-2 Support

1

Attempting to use Galore to finetune a phi model yields "AttributeError: 'PhiConfig' object has no attribute 'rms_norm_eps'", which, having gotten that error on other LLM things, typically translates to "this...