LoopControl comments

Repositories
Issues
Comments

Results 44 comments of


                                            LoopControl

Enabling typescript-eslint type-checked rules causes files which use svelte-modals to have spurious lint errors.

@mattjennings Did you find a solution/workaround for the Typescript prop inferring issue? The modal seems be working well after the upgrade to svelte 5 but i’m getting a typescript warning...

Add batched inference

This would be a huge improvement for production use. I tested locally with 4 parallel requests to the built-in ./server binary in llama.cpp and am able to hit some insanely...

Add batched inference

> @LoopControl How did you do 4 parallel requests to the ./server binary? Can you please provide an example, I'm trying to do the same. Thanks! There's 2 new flags...

Add batched inference

@zpzheng It’s a draft PR so it’s not complete - you can see “Add support for parallel requests” is in the todo list