tokenmonster icon indicating copy to clipboard operation
tokenmonster copied to clipboard

Published 20 hours ago • verified publisher icon alasdairforsythe

C implementation

Open abb128 opened this issue 1 year ago • 1 comments

Great work! I noticed however there's no implementation in C or C++, only in higher-level languages which may make it difficult to integrate into projects like llama.cpp. Is this something being worked on?

abb128 avatar Aug 03 '23 19:08 abb128

It will eventually get a native C implementation, but not in the near future. In the meantime its possible to export link from Go to C, via a C wrapper. I believe it's possible, but I've not looked into it yet. Let me know if you have any suggestions on how best to do it.

alasdairforsythe avatar Aug 03 '23 19:08 alasdairforsythe