Sam Spilsbury
Sam Spilsbury
@alehaa I'm not sure. I haven't been able to test this in some time. I'll be able to test it some time this week :)
On dev builds this appears to be happening since `index.html` isn't ready yet. Not sure why it happens on production builds.
Was just wondering if there was any update on this - I can also start looking into this myself
OK, perhaps I can try to backport ggerganov/llama.cpp#2411 to here?
Created #433 . I want to try and implement this in ggml-gobject as well, just to test that it works correctly (no reason why it shouldn't, since the allocator parts...
Really good idea! We can use this quite well in `ggml-gobject` with `GCancellable`. Just weighing in here - the callback should accept some `user_data` pointer. Eg: void ggml_graph_compute_with_abort(struct ggml_context *...
I ran into the same issue (filed then closed #671 ). My suggestion: Can MDS somehow warn if the given `size_limit` is `None` or exceeds `2**32`? At least this will...