dstack icon indicating copy to clipboard operation
dstack copied to clipboard

[Feature]: OCI spot instances

Open jvstme opened this issue 1 year ago • 3 comments

OCI provides preemptible (spot) instances with a 50% discount for most CPU shapes and some GPU shapes. At the moment the discount is available for P100 and V100 GPUs, but not A10 or A100.

jvstme avatar Jul 01 '24 06:07 jvstme

Implementation note: gpuhunt can use the allowPreemptible field in Cost Estimator's shapes.json to determine if the discount is available for a shape.

jvstme avatar Jul 01 '24 06:07 jvstme

OCI spot instances support is ready in dstack, but we cannot add spot offers to gpuhunt catalog yet, as they would break previous dstack versions that do not distinguish between on-demand and spot offers. We can add spot offers to catalog later, once dstack versions 0.18.3 and 0.18.4 become irrelevant.

jvstme avatar Jul 08 '24 06:07 jvstme

This issue is stale because it has been open for 30 days with no activity.

peterschmidt85 avatar Aug 08 '24 01:08 peterschmidt85

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] avatar Feb 13 '25 01:02 github-actions[bot]