llystar comments

Repositories
Issues
Comments

Results 3 comments of


                                            llystar

Starcoder mmap (and gpu) example

> Awesome! > > Is there a discussion somewhere about what shape adding new models to llama.cpp is going to take? > > I thought about making this PR against...

Starcoder mmap (and gpu) example

> > ./bin/starcoder -ngl 20 -t 24 -b 64 -m /data/WizardCoder-15B-1.0-GGML/WizardCoder-15B-1.0.ggmlv3.q4_0.bin > > Run ./starcoder-mmap if you have built this branch. thank you for the reply. after making ``` cmake...

Starcoder mmap (and gpu) example

> When I try your prompt and parameters using either starcoder or starcoder-mmap the output is , so appears unrelated to these changes. > > You can try a positive...