Results 46 comments of Brian

Did a comparison between my .args vs a different llamafile. I noticed I forgot `...` When I tried the above similar command to `mixtral-8x7b-instruct-v0.1.Q5_K_M.llamafile` it works. And this is it's...

Hmmm... looks like it's an explicit behavior of LoadZipArgs() to ignore any `.args` setting if within that file `...` is missing if user specified CLI arguments is provided. In my...

Okay, I've given the idea a shot of making `...` optional in `.args`. But it feels awefullly hackish... https://github.com/Mozilla-Ocho/llamafile/pull/204 I wonder if this could be done instead by getting cosmopolitan...

After some discussion with Justine, will move this fix upstream to cosmopolitan https://github.com/jart/cosmopolitan/pull/1086

Changes now in cosmopolitan https://github.com/jart/cosmopolitan/pull/1086#event-11492979262 and will eventually be integrated into llamafile on the next toolchain revision. This issue ticket should be considered solved and closed when that happen.

Okay was testing if this is solved by adjusting my build script in https://huggingface.co/mofosyne/TinyLLama-v0-5M-F16-llamafile/blob/main/llamafile-creation.sh so that the .arg is now ```bash cat >.args