jan
jan copied to clipboard
feat: Expose DRY and XTC parameters in frontend
Problem Statement
Llama.cpp has recently added support for the DRY and XTC sampling algorithms (https://github.com/ggerganov/llama.cpp/pull/9702 and https://github.com/ggerganov/llama.cpp/pull/9742, respectively).
DRY and XTC are widely used for creative tasks, and are recommended in the model cards of many popular finetunes.
Feature Idea
It would be nice to be able to set DRY and XTC parameters from the Jan frontend. SillyTavern already has a frontend for those samplers, which could be used as a reference.
That's a great find. Thank you.
stale