Benedikt Falk

Results 2 comments of Benedikt Falk
trafficstars

There is an issue with the current implementation as I pointed out in the issue mentioned in my last message. Starting a llama-server with the newest llama.cpp does not support...

I think we could still use the completions API, but still have to adapt to the response coming from the server, as the response structure has changed.