TcNo-TCHT
TcNo-TCHT copied to clipboard
PowerShell scripts is trying to install non-existing model
I have been used installation script (env, web-ui, wizard 13b model): iex (irm wizardlm.tc.ht)
On the step of downloading models, after choosing it "downloads" momently. (Actually, no model has been added into "models" folder). In the created launch bat file, I have noticed model named "ausboss-WizardLM-13B-Uncensored-4bit-128g". I have manually download model by WebUI (https://huggingface.co/WizardLM/WizardLM-13B-V1.2) and modify launch bat file to use it:
@rem setup installer env
cd text-generation-webui
python server.py --model WizardLM_WizardLM-13B-V1.2 --chat --model_type llama --wbits 4 --groupsize 128
Also, I have noticed that on step where you choose models to download and chose several times same model, it may "redownload" and assign instanced to same number (I had 2 points with number 3 for 13b model).
I don't know what part of PS script and how it manages model downloading (and which links are valid), therefore I am creating (and asking) to update PS script with actual models/links.