ggml icon indicating copy to clipboard operation
ggml copied to clipboard

ggml : add mechanism to abort `ggml_graph_compute()`

Open ggerganov opened this issue 1 year ago • 0 comments

In some cases, this call can take significant amount of time.

We should add an option to be able to provide a callback that will be used to check if the user requested the computation to be aborted after every graph node.

ggerganov avatar Jun 26 '23 17:06 ggerganov