open-interpreter icon indicating copy to clipboard operation
open-interpreter copied to clipboard

what is smallest model that know about comp system administration, network admin, etc?

Open zinwelzl opened this issue 1 year ago • 2 comments

Is your feature request related to a problem? Please describe.

No response

Describe the solution you'd like

I run ollama locally and need some small model for help with system administration, network administration, etc?

I try few small but are really bad.

Describe alternatives you've considered

No response

Additional context

No response

zinwelzl avatar Feb 14 '24 10:02 zinwelzl

How small do you need it to be? What hardware do you have?

Notnaton avatar Feb 14 '24 10:02 Notnaton

RAM 8 GB

zinwelzl avatar Feb 14 '24 12:02 zinwelzl

Try deepseek-coder I find it works quite well

There is a 7B, Q4 version that should work well on your ~6GB free VRAM card:

https://ollama.com/library/deepseek-coder:6.7b-instruct-q4_K_S

jerzydziewierz avatar Mar 12 '24 09:03 jerzydziewierz