text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Published 20 hours ago • verified publisher icon oobabooga

Official system requirements

Open programmingkidx opened this issue 1 year ago • 1 comments

Describe the bug

This isn't exactly a bug report but more of a question. What are the official system requirements for this software?

These fields should help:

  • OS version
  • Python version
  • Other requirement version

Is there an existing issue for this?

  • [X] I have searched the existing issues

Reproduction

Not applicable.

Screenshot

No response

Logs

Not applicable.

System Info

Not applicable.

programmingkidx avatar May 07 '23 21:05 programmingkidx

Requirements vary greatly between models, there's a list of some examples of vram/ram usage for different models on the wiki. This list doesn't include 4bit models but they should use a bit more than a quarter of what the 16bit models use. In theory you could run nearly any model on any system with ram and disk offloading but speeds will be very slow.

BetaDoggo avatar May 08 '23 00:05 BetaDoggo

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.

github-actions[bot] avatar Jun 08 '23 23:06 github-actions[bot]