llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Add --pre-tokenizer option to convert

Open Galunid opened this issue 8 months ago • 6 comments

Allow for overwriting pre-tokenizer when converting model. It's useful when models require third-party code to run (i.e MiniCPM-V-2.5).

@cmp-nct This will interest you

Galunid avatar Jun 16 '24 18:06 Galunid