Support local model repositories

[seanmor5]

[v-anyukov]

Would it make sense to to use https://hexdocs.pm/bumblebee/Bumblebee.html#t:repository/0 as model config? Bit more verbose, but provides full flexibility.

[seanmor5]

You can technically already force local models by setting BUMBLEBEE_OFFLINE and BUMBLEBEE_CACHE_DIR in the environment. The way I would add this is to probably add flags specifically to set these options explicitly before loading the model like:

mix honeycomb.serve --model-id={id} --model-cache-dir=/models --offline

which would set offline: true and then the cache directory as well