LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

Mention storage space needed to download models

Open JohannesGaessler opened this issue 3 months ago • 1 comments

Is your feature request related to a problem? Please describe.

When downloading a model, there is no indication of how much storage space will be needed. If you're familiar with how billions of parameters translate to GB and know what the default quantization is it's not much of an issue, but I think for an inexperienced user this would be useful to know.

Describe the solution you'd like

Show model size in Models tab, either next to the model name or when you click info. May make sense to add a warning if the model size exceeds system RAM since trying to run such models would not be feasible and can potentially lock up the system.

Describe alternatives you've considered

Additional context

JohannesGaessler avatar Sep 11 '25 13:09 JohannesGaessler

I agree. I am an "inexperienced user" running in Docker, with very limited resources. I am currently looking to install things for a base setup, and I have no idea how much space I need for a lot of those models and backends, etc...

All in all, this is a great project (the only one I found to work out of the box), so thank you. I have some criticisms of things which I think could be better, but this was one of the first problems I noticed. It would be great to include a "system requirements" section with needed resources spelled out.

wormuths avatar Sep 12 '25 19:09 wormuths