SyntaxError: JSON.parse: unexpected end of data

[stoykovstoyk]

Hello and thank you for the great product.

I experience a this trouble when I try to use it with local llama models.

At first it starts to generate some code and somewhere in the middle I receive this error

Unhandled Runtime Error SyntaxError: JSON.parse: unexpected end of data at line 1 column 1 of the JSON data

I tried many different models but every time I get the same error.

I saw in the models.ts file there is if (providerId === 'fireworks') { return 'json' }

So i tried to set if (providerId === 'ollama') { return 'json' }

but I still experience the same error.

Maybe the models do not response on proper JSON format or something else.

I also tried to add in the prompts.ts "You should response in JSON only" but it did not worked.

What could be the reason?

Is anyone able to help with this issue?

Once again I want to express my deep appreciation for this great project, but running a local models is a must have for my use case that is why I decided to open this issue.