Scott Henderson

Results 272 comments of Scott Henderson

Thank you @jacobtomlinson for the detailed perspective and suggestions! > As for quotas I'm afraid you will need to limit this from the Pangeo admin point of view. The NFS...

Sounds good @yuvipanda. I wonder if a bit of logic to check the cloud provider might also be good somewhere in this toolchain? For example when building we install a...

> Looks to me like you are requesting 0.5 cpu and you have 0.49 left on this node, nominally. (I don't think it will give you exactly 100% possibly because...

@jcrist and @consideRatio - I opened a similar issue related to dask worker scheduling on dask-kubernetes a while back which I think is informative https://github.com/dask/dask-kubernetes/issues/233 > Make changes to inform...

I'd say simply printing a message to stdout would be sufficient for these two cases per @TomAugspurger 's comment above: 1) `cluster = gateway.new_cluster()` --> `dask scheduler requested, may take...

@jhamman and @yuvipanda - I think this got resolved last week, correct?

Thanks @ocefpaf ! This is great information. After adding your suggestions things proceed but definitely still feel slow. In case we want to modify our base environment coming from Docker,...

thanks again. pinging @rabernat and adding a couple links to related issues: conda-forge packages: https://github.com/pangeo-data/pangeo-stacks/issues/23 image size: https://github.com/pangeo-data/pangeo-stacks/issues/22

Also, one more comment confirming that b/c we've set dask workers to have the same home directory you can launch a KubeCluster that matches a user-created conda environment with the...

just documenting that for persistent user-defined conda environments we currently must place this config file in `/home/jovyan/.condarc`: ``` # Override Dockerfile conda settings channel_priority: strict channels: - conda-forge - defaults...