devika icon indicating copy to clipboard operation
devika copied to clipboard

Support to run entirely locally with LocalAI

Open mudler opened this issue 1 year ago • 4 comments

First of all - thank you for your hard work, from a maintainer to a maintainer, I think projects like this should exist - so I'm happy to see the community to step up!

I'd like to use devika, but I want to use it 100% Local, for instance with LocalAI ( https://github.com/mudler/LocalAI ) which is an OpenAI free alternative.

Some context:

I'm the author of LocalAI, I can likely help in anything you need from the backend to make this working properly.

mudler avatar Mar 27 '24 21:03 mudler

That's interesting, I am willing to contribute as well.

shrinivaspatwardhan avatar Mar 28 '24 00:03 shrinivaspatwardhan

Hi I am new to this(open source on AI), but isn't using Ollama for llama2 an offline/local procedure?

Thanks!

obliviousz avatar Mar 30 '24 14:03 obliviousz

that's correct. infact a similar project is OpenDevin that's an open-source version of Devin that i came across today

shrinivaspatwardhan avatar Mar 31 '24 08:03 shrinivaspatwardhan

@shrinivaspatwardhan Would you be willing to take it as a integration of LocalAI into Devika?

franklinselva avatar Apr 02 '24 05:04 franklinselva