Vyacheslav

Timeout for long generation

6

how do I set a timeout? If the generation is on the CPU (for example, Mixtral 8x22b), then it falls off after a timeout.

Support TURBO model

1

Please add support TURBO model