Stealthwriter

Results 13 comments of Stealthwriter

Support for deberta-v2 model variant

please add deberta

Control frequency - completion

How does llm engine differs from TGI and VLLM?

Request support for Llama Prompt Guard

Deberta V3 is widely used it should be supported

Request support for Llama Prompt Guard

Deberta v3 large is the best model out there for text classification, it's top rated in kaggle competitions is it supported? On Wed, Jan 29, 2025 at 6:30 PM Brady...

[Bug] Please support mistral3 architecture

any updates?

[BUG] Loading big dataset with 2 million examples is causing an error

using nightly build docker

[Feature]: Support `resources` with the `gateway` configuration type

skypilot has this already. Customizing SkyServe controller resources You may want to customize the resources of the SkyServe controller for several reasons: Use a lower-cost controller. (if you have a...

[Feature]: Support `resources` with the `gateway` configuration type

this issue is causing a bottle neck for users who have many services/users

[Feature]: Support `resources` with the `gateway` configuration type

good idea thanks

[Bug]: Services stop responding after `dstack-gateway` reboot

yea same issue