Wagner Bruna comments

Repositories
Issues
Comments

Results 84 comments of


                                            Wagner Bruna

[Feature] Sequential model loading

Possibly a duplicate of #908 .

"ggml.c:1516: GGML_ASSERT(ctx->mem_buffer != NULL) failed" error keeps coming up.

I'd expect a 1.5G CPU allocation to work even if it is indeed a 32 bit build. @3Rr0RHACK3R , testing here manually with `--type q5_1`, I'm getting different (a bit...

"ggml.c:1516: GGML_ASSERT(ctx->mem_buffer != NULL) failed" error keeps coming up.

> downloaded the model from gpu stack in huggingface Are you sure? I can't find that specific quant on https://huggingface.co/gpustack/stable-diffusion-v1-5-GGUF/tree/main . Perhaps it's this one? https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/tree/main

"ggml.c:1516: GGML_ASSERT(ctx->mem_buffer != NULL) failed" error keeps coming up.

Please post another run with that exact model and the `-v` option. > and also , I found out the problem is because of GGML , cause when i use...