Zhanghao Wu comments

Results 315 comments of


                                            Zhanghao Wu

Deployment Issue with serving Model on RunPod

Thanks for checking in @Scott3730! This is on our roadmap, and we will try to support it soon. Related to @3323

[K8S] `sky local up` failed on a multi-user system

We can probably attach a user hash to the yaml name : )

`sky launch` takes ~5s to print out optimizer table, which is slow

That sounds great @aylei! Thanks for sharing the detailed analysis. Let's work on the proposals you mentioned. : )

`sky launch` takes ~5s to print out optimizer table, which is slow

Hi @aylei, thanks for the analysis. Actually, it seems like using the `aws configure list` is not that bad idea, as `get-caller-identity` is actually on the critical path of many...

[Storage][k8s] Support mounting data sources on Kubernetes cluster

With #3689, we are able to set volume mount per task in the task yaml.

Does skypilot support to inferece Llama2-70B in multiple GPU nodes?

This can be added to our AI gallery.

[UX] Explain the reason of empty `sky jobs queue` result when job controller is stopped

Good point! We should probably hint that `sky jobs queue --refresh` could retrieve the previous finished jobs.

Add ovhcloud

Thanks for submitting the PR @Wats0ns! The support for OVHcloud is very exciting! Should we do a review pass for this PR? It would be nice if we can rebase...

> Hey @Michaelvll, thanks for your time ! It seems that there is a test failing because it needs [skypilot-org/skypilot-catalog#48](https://github.com/skypilot-org/skypilot-catalog/pull/48) to be approved, could you give it a go please...

Add ovhcloud

Hi @Wats0ns, sorry for the delay! We are migrating all our new cloud support to a new provisioner API. Could you help migrating the OVHcloud implementation to the new provisioner?...