Nigel Todman comments

Repositories
Issues
Comments

Results 3 comments of


                                            Nigel Todman

llama.exe doesn't handle relative file paths in Windows correctly

Not sure if related. But the ggml-model-q4_0.bin I am getting is only 296kb There is no error. ``` C:\llama\models\7B>quantize ggml-model-f16.bin ggml-model-q4_0.bin 2 llama_model_quantize: loading model from 'ggml-model-f16.bin' llama_model_quantize: n_vocab =...

Directory structure and files to avoid model downloads.

I notice the md5 for the largest file is present in checklist.chk I may put in a pull request to md5 existing files and skip if they are already valid....

Directory structure and files to avoid model downloads.

``` C:\Users\VTSTech\dalai\llama\models>dir /s Volume in drive C is HITACHI-1TB Volume Serial Number is 62C9-A8A2 Directory of C:\Users\VTSTech\dalai\llama\models 2023-03-19 02:13 PM . 2023-03-19 02:13 PM .. 2023-03-19 02:22 PM 7B 2023-03-19...