iChristGit
iChristGit
> Currently, only support online services with OpenAI interface style. The request code can be found here: > > https://github.com/lobehub/lobe-chat/blob/97dd03e0d0b4305b7fa4b317d66417b25c29ae26/src/app/api/openai/createBizOpenAI/createOpenai.ts#L16 > > This is initiated by a cloud server and...
> For anybody having troubles still, you can try using newer library - https://github.com/james-things/bitsandbytes-prebuilt-all_arch Using v37 did it for me finally :) > For future reference, the 8 bit windows...
> > For anybody having troubles still, you can try using newer library - https://github.com/james-things/bitsandbytes-prebuilt-all_arch Using v37 did it for me finally :) > > [#20 (comment)](https://github.com/oobabooga/text-generation-webui/issues/20#issuecomment-1455762694) > > This...
I did a reinstall of transformers (pip uninstall transformers pip install git+https://github.com/oobabooga/transformers@llama_push) Now getting this: Loading llama-13b... Traceback (most recent call last): File "D:\MachineLearning\TextWebui\text-generation-webui\server.py", line 194, in shared.model, shared.tokenizer =...
Dow > > IndentationError: unindent does not match any outer indentation level > > This means you changed the main.py file incorrectly. You have changed how many spaces are before...
> Should just be on line 368. > > The entire line should look like: ` if torch.cuda.is_available(): return 'libbitsandbytes_cudaall.dll', None, None, None, None` > > Noting the 4 spaces...
@mishig25 Hey! Any idea what am I doing wrong?
@nsarrazin Can you help me figure it out?
Also tried: ``` MONGODB_URL = mongodb://127.0.0.1:27017 MODELS=`[ { "name": "HuggingFaceH4/zephyr-7b-beta", "datasetName": "HuggingFaceH4/ultrachat_200k", "description": "zephyr-7b-beta", "websiteUrl": "https://research.Trelis.com", "userMessageToken": "", "userMessageEndToken": " [/INST] ", "assistantMessageToken": "", "assistantMessageEndToken": " [INST] ", "chatPromptTemplate" :...
> Hi, could you comment the template in code blocks > > ``` > like this > ``` > > So I can have a look ? In the meanwhile...