LUCAS M MORGAN

> I am having the same problem trying to load OccamRazor/mpt-7b-storywriter-4bit-128g. > > I can get the og mosaicml/mpt-7b-storywriter working. > > I get the same ERROR:Can't determine model type...

the xformers library def needs to be installed in the env, which is managed by mamba. I was able to get it working with these steps, hopefully it helps: 1)...

The env and the mamba stuff is here:  I'm on windows, so for me the micromamba-cmd.bat is located here. I was able to double click and it opened up...

that's weird! I'm not sure. fyi for context I used the one click installer to set everything up, not sure if it would behave differently if you installed it another...

also had this issue, and this solved it for me. I was using searxng app in my unraid nas, and the setting is not in the preferences gui so far...