jan icon indicating copy to clipboard operation
jan copied to clipboard

feat: Expose DRY and XTC parameters in frontend

Open p-e-w opened this issue 1 year ago • 1 comments

Problem Statement

Llama.cpp has recently added support for the DRY and XTC sampling algorithms (https://github.com/ggerganov/llama.cpp/pull/9702 and https://github.com/ggerganov/llama.cpp/pull/9742, respectively).

DRY and XTC are widely used for creative tasks, and are recommended in the model cards of many popular finetunes.

Feature Idea

It would be nice to be able to set DRY and XTC parameters from the Jan frontend. SillyTavern already has a frontend for those samplers, which could be used as a reference.

p-e-w avatar Nov 05 '24 06:11 p-e-w

That's a great find. Thank you.

louis-jan avatar Nov 09 '24 15:11 louis-jan

stale

freelerobot avatar Jul 02 '25 06:07 freelerobot