llm-atc
llm-atc copied to clipboard
Skypilot Spot Instances
Apparently Skypilot uses spot instances. Is there currently a way to activate this option when using llm-atc?
The folks over at Skypilot tell me they are releasing sky serve with spot serving capabilities. Going to wait for their update to land in skypilot before I update this.