kuvaus

Use llama-api to automatically handle mlock and mmap

1

Uses the llama-api functions to automatically enable mlock and mmap if they are supported. ```c++ d_ptr->params.use_mmap = llama_mmap_supported(); d_ptr->params.use_mlock = llama_mlock_supported(); ```

Add compatibility with new sampling algorithms in llama.cpp

1

Title: Add compatibility with new sampling algorithms in llama.cpp Description: This pull request addresses issue https://github.com/nomic-ai/gpt4all-chat/issues/200#issue-1689677866 by adding compatibility with new sampling algorithms in llama.cpp. Changes: Implemented temperature sampling with...

New llama.cpp update breaks llamamodel.cpp compatibility

3

Issue: Need to remove`llama_sample_top_p_top_k` function in `llamamodel.cpp` and call the new sampling functions in `llama.cpp/llama.cpp`instead. Description: There's a new update to `llama.cpp` that changes the `llama_sample_top_p_top_k` function. The commit can...