openchat icon indicating copy to clipboard operation
openchat copied to clipboard

Published 20 hours ago • verified publisher icon imoneoi

What is a minimum hardware requirements for setup as a sever ?

Open Altenrion opened this issue 11 months ago • 0 comments

I was trying to setup this project on different virtual environments without any luck.

There is no clear information abut the minimum and recommended hardware and software setup. I found in one of the closed issues, that you recommnd to use A100 40 GB GPU (which is still over expensive right now).

Tried some GPUs

  • 1080 8GB (not started due to outdated drivers for everything)
  • T4 16GB (eventually started but ran into OOM error)

So what i ask for, is to clarify how to ran this project with 16-24 GB of GPU memory or provide real MINIMUM hardware requirements, that would be easy to see and get into account.

Thanks in advance!

Altenrion avatar Mar 09 '24 14:03 Altenrion