Steward Garcia

icon company Fast Smart System icon location Nicaragua icon location I'm an independent game developer. I'm from Nicaragua. I know to code in Java, C/C++, Python, Javascript. My main knowledges are Open GL, linear algebra, etc.

Results 2 issues of Steward Garcia

the gguf module in ggml.c must have an option to write as a stream.

GGUF should allow writing through a stream since calling `gguf_write_to_file` makes a copy of the data internally, It would be best to write the tensor data to a file stream,...

WIP - Web server + conv2d fused + k-quants + dynamic gpu offloading

17 comment

This PR will probably take me a very long time since I'll have to make many modifications to the code. Due to changes in the way of building the computation...