Jun Zhang

Results 30 comments of Jun Zhang

The first initial draft PR (#3536) was submitted.

I have created a llm.c fork in https://github.com/junaire/llm.c/tree/jun/wasmedge to support our plugin, maybe you can take a look so we can discuss the design @hydai

> I create wasmedge/llm.c via forking the upstream. You can submit your PR there: https://github.com/WasmEdge/llm.c [PR](https://github.com/WasmEdge/llm.c/pull/1) submitted, I feel like there are a lot of things that we should discuss.

> Hi @junaire You can book a slot during the office hour. hi, sry for the late response, i was very busy with my other projects recently. im not sure...

i would like to work on the rust binding next, but where should we put that? do we need to create a new repo? @hydai

> @junaire The repo is created: https://github.com/WasmEdge/wasmedge-llmc Draft PR is submitted: https://github.com/WasmEdge/wasmedge-llmc/pull/1

hi @hydai, do you want me to work on the GPU training for the plugin? I have done some research on llmc's CUDA code, and it feels like it's more...

> > hi @hydai, do you want me to work on the GPU training for the plugin? > > Definitely. If you are able to work on GPU, that would...

Is there anything else you'd like me to deliver on this project? if not i would suggest to close the issue and mark the project as done :)

just fyi, i rewrite it in C++ 🤓 https://github.com/junaire/coomer