Zennou

Results 6 comments of Zennou

You might have fixed that, but now if you try to generate you get the following error. ``` ERROR | __main__:generate:6325 - Traceback (most recent call last): File "aiserver.py", line...

Yup getting the same problem. Also tried redoing it and still got the same result. EDIT: !pip install -q torchsde Just add that underneath the other ones like it and...

> > Did you set MP to '2' here? > > https://github.com/oobabooga/text-generation-webui/blob/main/modules/LLaMA.py#L18 > > See > > https://github.com/facebookresearch/llama#inference > > ``` > from llama import LLaMA, ModelArgs, Tokenizer, Transformer >...

Didn't they already do this? https://github.com/TavernAI/TavernAI/issues/1

Huh, weird that the hastebin decided to die. I'll just paste in github to avoid that. ``` INFO | __main__:get_model_info:1662 - Selected: OAI, INIT | Retrieving | OAI Engines INIT...

Yup, can confirm this an issue, dealt with it for a long time before jumping ship to Tavern.