pangeo-cloud-federation

pangeo-cloud-federation copied to clipboard

Adding GPUs

7

I've started down the GPU rabbit hole. My initial efforts are focusing on getting GPUs added to the GCP hubs (hydro/ocean). Things have not worked first try so I'm hoping...

jhamman

dask pod service account access to non public storage (s3, gs buckets)

9

For better security and cost-savings we are moving towards non-public (requester pays) buckets for data storage. To access these buckets on AWS we recently reconfigured the hubs to assign an...

scottyhq

refactor circleci config to do each hub in parallel

3

As we add more and more hubs to this repo, I worry about one interfering with the others. Currently our script is set up like this - build - dev.pangeo.io...

rabernat

HCP Pangeo on AWS

1

Hello! Thanks to a recently-funded BRAIN grant (another one!) I am developing a new deployment of Pangeo that will target the [Human Connectome Project](https://registry.opendata.aws/hcp-openaccess/). Since the data is already on...

arokem

github users with hypen (-) in names get duplicate home directories on AWS hubs

3

We've noticed at geohackweek that github users with a hyphen in their user name are getting two home directories behind the scenes on our AWS EFS drive. Don't have time...

scottyhq

aws-node NetworkPlugin cni failures on AWS Hubs

2

For some time we've been noticing network related errors on AWS hubs when scaling up from zero nodes. This hasn't been too much of a concern because things usually recover...

scottyhq

Optimizing AWS EFS (nfs drive) Configuration and Performance

6

We are currently using AWS EFS for user home directories on all hubs. This is great because it allows multiple nodes (for example notebook and dask workers) to access the...

scottyhq

## Pangeo Community Meeting Working Group Report & Wishlist At the August 20, 2019 Pangeo Community Meeting we had a brief session to discuss alternatives for managing hubs in the...

scottyhq

Should (can) we move domain specific hubs here?

8

In the weekly Pangeo developers call today, this topic came up. Should we move the domain specific deployments (atmos, ocean, polar, hydroshare, etc.) to this repo? We seem to be...

jhamman

support for long-running or batch jobs on pangeo hubs

3

This is an issue that keeps coming up with users of the hubs. People want a code cell from their notebook or terminal command to continue to run after their...

scottyhq