Benedikt Falk
Results
2
comments of
Benedikt Falk
trafficstars
There is an issue with the current implementation as I pointed out in the issue mentioned in my last message. Starting a llama-server with the newest llama.cpp does not support...
I think we could still use the completions API, but still have to adapt to the response coming from the server, as the response structure has changed.