llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Published 20 hours ago • verified publisher icon ggml-org

added ctx_size parameter

Open RazeLighter777 opened this issue 1 year ago • 3 comments

Adds a parameter called context size (-c for short) that allows taking the context size from the user's input.

Defaults to the same hardcoded 512.

RazeLighter777 avatar Mar 15 '23 01:03 RazeLighter777

Usage -c N, --ctx_size N

RazeLighter777 avatar Mar 15 '23 02:03 RazeLighter777

https://github.com/ggerganov/llama.cpp/issues/71#issuecomment-1466943009 feel free to take a look at this diff, theres probably two other lines you want to change. Probably ignore the EPS stuff though that should be changed too at some point.

eous avatar Mar 15 '23 02:03 eous

Not 100% sure if this is right but I added it.

RazeLighter777 avatar Mar 15 '23 02:03 RazeLighter777