llama.cpp
llama.cpp copied to clipboard
Add support for file load progress reporting callbacks
A new pair of properties have been added to llama_context_params, a function pointer and an arbitrary context pointer that will be passed to the function pointer along with estimated read progress. The handler will be called (if provided) whenever dots are printed out while loading the model.
Good ideas! Updated.