ai-shell icon indicating copy to clipboard operation
ai-shell copied to clipboard

Published 20 hours ago • verified publisher icon BuilderIO

Run locally, for free

Open knoopx opened this issue 1 year ago • 7 comments

Have you considered using langchain+some truely-open source model?

there's also a JS port of langchan + alpaca: https://github.com/linonetwo/langchain-alpaca

can't recommend any use-case specific open model but perhaps this is something that could be easily fine-tuned by feeding man pages+examples?

knoopx avatar Apr 08 '23 19:04 knoopx

would love this. would be great to support choosing between different models (including free/oss ones) via configs (kinda like on nat.dev). interested in sending a PR for that?

steve8708 avatar Apr 08 '23 23:04 steve8708

this could also be tied to #15

steve8708 avatar Apr 09 '23 00:04 steve8708

by integrating langchain you get multi-model support + prompt templating + lots of other stuff this project might not need. also not sure how complete/compatible the JS version is, only used the python implementation.

knoopx avatar Apr 09 '23 01:04 knoopx

Absolutely, PRs welcome with any improvements you have in mind!

steve8708 avatar Apr 09 '23 17:04 steve8708

hey @knoopx working on this ? or anyone else?

I'm interested in a PR if no one is currently working on it.

AlaEddineBoughanmmi avatar Apr 11 '23 01:04 AlaEddineBoughanmmi

@AlaEddineBoughanmmi no I don't, honestly I would rather wait until things seattle a little bit, too much stuff going on right now. reasons here: https://www.reddit.com/r/Oobabooga/comments/12h6pfb/the_llama_tokenizer_needs_to_be_reconverted_in/

knoopx avatar Apr 11 '23 19:04 knoopx

I agree

AlaEddineBoughanmmi avatar Apr 11 '23 21:04 AlaEddineBoughanmmi