Richard Groves

Further investigation has found the specific problem, but no clearer as to whether it is Ollama or modelfusion at fault. So with llama3 this works: `curl http://localhost:11434/api/chat -d '{"stream":true,"model":"llama3","messages":[{"role":"system","content":"You are...

There is the same problem with Phi-3 model on Ollama: `ollama pull phi3` `curl http://localhost:11434/api/chat -d '{"stream":true,"model":"phi3","messages":[{"role":"user","content":"What is 1+1?"}],"options":{"stop":[]}}'` Note it will stop eventually when an empty content response is...

@danielgen @olinorwell Are you able to trace the request sent to the Ollama server from those external tools to see if it is the same `"options":{"stop":[]}` problem I've written about...

Trying to narrow this down more - the `createReadStream` route might be working. Having some async issues seeing that I think. What is definitely is not working is: ``` let...

@brendanprice2003 Sorry, no. I had to move on to something else and this got left behind. I'll try and dig into the latest code and logs and see if it...

@brendanprice2003 Do you have a file that breaks the code that you can share? I was not able to share the ones that broke it for us, and it was...

Oh - that's very worrying. In the use case I had it was lots of files being sent through the same processing code, and some would fail - I didn't...

Line 1547 of STKAudioPlayer.m - https://github.com/tumtumtum/StreamingKit/blob/master/StreamingKit/StreamingKit/STKAudioPlayer.m#L1547 - is a return statement inside a read < 0 if clause - no 'delta' around. Do you have the right file/line number or...

The current architecture of the library doesn't allow it to report this. The STKCoreFoundationDataSource is built on top of CFReadStream which has no methods for reporting how much data is...

@pahud is there anything that can be done to encourage getting this merged in? We really need it in our project to be able to setup eks clusters properly in...