TcNo-TCHT icon indicating copy to clipboard operation
TcNo-TCHT copied to clipboard

PowerShell scripts is trying to install non-existing model

Open Jeidoz opened this issue 1 year ago • 0 comments

I have been used installation script (env, web-ui, wizard 13b model): iex (irm wizardlm.tc.ht)

On the step of downloading models, after choosing it "downloads" momently. (Actually, no model has been added into "models" folder). In the created launch bat file, I have noticed model named "ausboss-WizardLM-13B-Uncensored-4bit-128g". I have manually download model by WebUI (https://huggingface.co/WizardLM/WizardLM-13B-V1.2) and modify launch bat file to use it:

@rem setup installer env
cd text-generation-webui
python server.py --model WizardLM_WizardLM-13B-V1.2 --chat --model_type llama --wbits 4 --groupsize 128

Also, I have noticed that on step where you choose models to download and chose several times same model, it may "redownload" and assign instanced to same number (I had 2 points with number 3 for 13b model).

I don't know what part of PS script and how it manages model downloading (and which links are valid), therefore I am creating (and asking) to update PS script with actual models/links.

Jeidoz avatar Sep 09 '23 19:09 Jeidoz