Echosky

Results 7 comments of Echosky

What I did was changing this line `cmd = cmd = ["llama/main", "-p", prompt]` to pointing to my llama model. However, to fully run locally, you also need a embedding...

> @ai8hyf it would be great if you could share how you made run fully locally as soon as you get it done :) thx Just check this out: https://python.langchain.com/en/latest/use_cases/agents/baby_agi.html...

> > What I did was changing this line `cmd = cmd = ["llama/main", "-p", prompt]` to pointing to my llama model. However, to fully run locally, you also need...

> > > @ai8hyf it would be great if you could share how you made run fully locally as soon as you get it done :) thx > > >...

> I'd love to get the llama code updated. The initial hack was based on building/running llama.cpp under Linux, so no support for Windows. Also, the embeddings are still based...

> > > > > @ai8hyf it would be great if you could share how you made run fully locally as soon as you get it done :) thx >...