Pavel Zorin

Results 58 comments of Pavel Zorin

Hi @QuantumPlayDev. Thanks you for the interesting issue and questions. First of all, If I understand it correctly, the main problem is that llama server can't handle the required load...

Looks good. 👍 Is there a chance to figure out the reason why unit tests failed?

Bringing more details to the PR ### What problem is attempted to solve: If a user runs an LLM locally with limited resources it might not handle the default requests...

Hi @Geoff-Robin. Thanks you for the interesting idea! It turns integration tests into isolated unit tests with mocked environment. So we can run integration tests with VCR and we won't...

What's the status of this PR?

I'm worried about our Orka VMs capacity. 22 parallel steps will not fit it. It will clog up our cluster.

IMHO this requirement can be reconsidered. The load to the macos instances may be too high