llama_cpp_dart icon indicating copy to clipboard operation
llama_cpp_dart copied to clipboard

Question: is the project on hold?

Open yuvalr1 opened this issue 1 year ago • 6 comments

Quote from readme:

This project, a Dart binding for llama.cpp, is currently on hold as we await the porting of llama.cpp helpers code to C

Is there a link, potentially to the github issue in the llama.cpp repository so we can understand and follow on the status of the dependency?

Thank you very much for this project!

yuvalr1 avatar Oct 31 '24 12:10 yuvalr1

@yuvalr1 yes, but not for long as https://github.com/ggerganov/llama.cpp/issues/5214 was resolved lately, this will allow generating binding without C wrappers.

netdur avatar Oct 31 '24 14:10 netdur

Whats the current progress on this? Has the resolution in Llama.cpp issue made your life easier? Look forward to the updates! @netdur

ArachnaDigitalLtd avatar Nov 19 '24 11:11 ArachnaDigitalLtd

Thanks @netdur! I'm ok with closing the issue unless you want to leave it open.

yuvalr1 avatar Nov 19 '24 13:11 yuvalr1

@ArachnaDigitalLtd dev branch is now available for review. while it's still a work in progress, the implementation is functional and ready for testing @yuvalr1 I will close once with release of v0.0.8

netdur avatar Nov 24 '24 17:11 netdur

Congrats for resuming work on this project @netdur ! Highly beneficial for the Flutter community. I will give it a try as I wish to move from my prev implementation to yours. Hope to contribute one day if I get to use it.

Is there any details on what is actually supported from the official current llamacpp API / what is not?

Thank you again

JulienElkaim avatar Dec 14 '24 04:12 JulienElkaim

I will close once with release of v0.0.8

It got released, I think this issue can be closed.

guyluz11 avatar Feb 03 '25 12:02 guyluz11