llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Add support for file load progress reporting callbacks

Open j-f1 opened this issue 2 years ago • 1 comments

A new pair of properties have been added to llama_context_params, a function pointer and an arbitrary context pointer that will be passed to the function pointer along with estimated read progress. The handler will be called (if provided) whenever dots are printed out while loading the model.

j-f1 avatar Mar 23 '23 17:03 j-f1

Good ideas! Updated.

j-f1 avatar Mar 23 '23 20:03 j-f1