Multiple files don't appear in one click download

[To1p5]

Describe the bug

Whenever I use the one-click installers for windows I don't seem to get the same files downloaded everyone else gets. I see people usually get the files 'install-bat' 'INSTRUCTIONS.txt' 'micromamba-cmd.bat' 'start-webui.bat' and 'download-model.bat'. I get 'cmd_windows', 'INSTRUCTIONS', 'start_windows', 'update windows' and 'webui'. I was able through videos to get the installer files and text-generation-webui but I don't seem to be able to fix this issue is this due to an update?

Is there an existing issue for this?

• [X] I have searched the existing issues

Reproduction

click the one-click installers for windows

Screenshot

Logs

none

System Info

Nvidia GEFORCE RTX 3060

[WhatDeFuuu]

I also got the same files I am very confused as well

[CarlKenner]

I think you are using a later version of the one-click installer than other people.

• start_windows now both installs and runs it.
• miniconda is now used instead of micromamba.
• if you want to modify the command-line parameters you have to edit webui.py.
• Supposedly you can now download models from the GUI and don't need to use download-model.bat, (but I still use the old download-model.bat).

[To1p5]

how can I start the program without the start-webui.bat file this is how my setup looks like currently

[CarlKenner]

I told you. Use start_windows.bat

[To1p5]

got it just worked now I am using a machine with 6 gbs of vram would that be enough? Also is there a way to add models I'm trying to add the vicuna model

[CarlKenner]

got it just worked now I am using a machine with 6 gbs of vram would that be enough? Also is there a way to add models I'm trying to add the vicuna model

I only have 4 gbs of vram. Some models work for me, some don't. As a rule of thumb, you'll have better luck with models with less parameters than the size of your graphics card. I haven't tried adding the Vicuna model yet.

There are two different versions of the Vicuna model, v0 and v1.1, and they use different instruction formats. Currently, oobabooga only really supports v0, but I have a pull request where I helped add v1.1 support. For now, if you're trying to use Vicuna v1.1, you can get it working better by changing the AI's name and your name in the character tab.

[RuseTiger]

I have the same issue, I personally didn't notice it until I tried to use a larger model and went to edit the file so I could run it with lower VRAM (I am literally 20mb's under the necessary VRAM for the model and that 20 is only requested when the model is about to finish a sentence or paragraph meaning it produces all but the last ~5 words). In any case I went looking for the server.py line in the bat file (in the start windows.bat file) and realized it doesn't exist, I checked the rest of the .bat's and didn't find anything. I looked around on youtube and found that I was missing files as you were.

They don't seem to be necessary anymore for getting the program running but the change has created an issue if you need to edit anything, the webui.py line in the startwindows.bat file is not meant to be used for arguments and the whole thing crashes if you add arguments to it or create your own line based on the instructions included in the .zip file (which haven't been updated for the new version yet from what I can tell as they appear to be the same as what was packaged with the older version). Is it possible to download the other version's files and get them to work with your current install or would you need to wipe everything and then download the older version and start from scratch? I don't really see any way to fix the current version unless I am missing something obvious here.

[To1p5]

I am having somewhat of a similar issue since I only have 6gbs of vram I am trying to download a different model than the facebook_opt-6.7b model. i think there is supposed to be a way you can do it via the ui still trying to figure out how to do that though. I see a youtuber called Aitrepreneur put out an updated video for the download process but I don't see any mention in regard to bringing in old files

[github-actions[bot]]

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.