llama.clj icon indicating copy to clipboard operation
llama.clj copied to clipboard

Convenience Namespace for Using/Obtaining Models

Open jaketothepast opened this issue 4 months ago • 2 comments

Hello!

I saw this in the Roadmap, and I've somewhat implemented this myself for a side project using your library. Are you open to contributions with this item?

My approach:

I have a .edn file that defines the filepath to drop the models, in and if I load up my application and call into my namespace with a model URL that hasn't yet been downloaded, my code will download that model and return a promise and resolve the llama-context lazily in the application code. I can contribute this model loading namespace!

jaketothepast avatar Sep 30 '24 21:09 jaketothepast