dstack icon indicating copy to clipboard operation
dstack copied to clipboard

[Feature]: Support the Capacity Blocks for ML feature for AWS

Open peterschmidt85 opened this issue 1 year ago • 9 comments

Problem

With AWS, Capacity Blocks for ML is the main way to access H100 today.

Solution

No response

Workaround

No response

Would you like to help us implement this feature by sending a PR?

Yes

peterschmidt85 avatar Apr 22 '24 14:04 peterschmidt85

@peterschmidt85, please describe what's meant by the support for Capacity Blocks. Do you suggest dstack provides an interface to purchase reserved instances or do you suggest dstack should be able to launch instances in capacity blocks purchased by users?

r4victor avatar Apr 23 '24 04:04 r4victor

Also note that testing EC2 Capacity Blocks for ML can be costly. The minimum reservation price is p4d.24xlarge for 1 day =. $14.75 * 24 = $354.

r4victor avatar Apr 23 '24 04:04 r4victor

@peterschmidt85, please describe what's meant by the support for Capacity Blocks. Do you suggest dstack provides an interface to purchase reserved instances or do you suggest dstack should be able to launch instances in capacity blocks purchased by users?

@r4victor I think, we only need to add a way to specify the existing reservation ID. I believe this can be a field in YAML/Profile.

peterschmidt85 avatar Apr 23 '24 07:04 peterschmidt85

This issue is stale because it has been open for 30 days with no activity.

peterschmidt85 avatar May 24 '24 01:05 peterschmidt85

This issue is stale because it has been open for 30 days with no activity.

peterschmidt85 avatar Jun 30 '24 01:06 peterschmidt85

This issue was closed because it has been inactive for 14 days since being marked as stale. Please reopen the issue if it is still relevant.

peterschmidt85 avatar Jul 14 '24 01:07 peterschmidt85