pangeo-cloud-federation icon indicating copy to clipboard operation
pangeo-cloud-federation copied to clipboard

Configure Globus Connect Personal on ocean.pangeo.io

Open jhamman opened this issue 5 years ago • 10 comments

We should be able to configure a Globus Connect Personal on hubs that use the globus auth option (currently just ocean.pangeo.io).

@rpwagnerbuilds has shared some configuration tools that may help to make this possible: https://github.com/rpwagnerbuilds/z2jh-gcp

xref: https://twitter.com/rpwagner/status/1204918690900144128

cc @rabernat, @rpwagner

jhamman avatar Dec 13 '19 19:12 jhamman

The method we're using current automatically registers a Globus Connect Personal endpoint the first time a user logs into the JupyterHub instance. The configuration is saved in the user's home directory so the endpoint will start whenever they log in.

The GCP software and some scripts are installed into the Notebook Server container via the Dockerfile. There's a change to the KubeSpawner that triggers the creation and startup process. It also requires the Globus Transfer token to be passed into the user's environment. From what I saw, you might have c.GlobusOAuthenticator.exclude set to prevent that currently.

Do you have a test environment? I'd be glad to contribute the necessary chunks via a PR. Eventually, I'd like to make this generally a configuration option for z2jh after it's gone through a couple of use cases.

FYI: this is my actual GitHub account, @rpwagnerbuilds is used for CI.

--Rick

rpwagner avatar Dec 16 '19 07:12 rpwagner

@rpwagner - yes, we have a dev environment. This repo includes a CICD workflow that deploys the staging branch automatically after changes are merged. Before we go there, let's hear from @rabernat on what he is hoping for in terms of feature development in this area.

jhamman avatar Dec 19 '19 00:12 jhamman

This came up again our our cloud-ops WG meeting today. I think the best path forward would be a quick call to understand how globus might be able to help with some of our cloud pain points.

@rpwagner - what's your availability like this week? Can you find 30 minutes to chat with me and Joe?

rabernat avatar May 11 '20 17:05 rabernat

I'm pretty open after noon tomorrow during the week. Let me know what works.

rpwagner avatar May 11 '20 17:05 rpwagner

Great! Would 2pm ET, tomorrow (Tuesday, May 12) work for you and @jhamman?

Perhaps @consideRatio might want to join too, although the timing is bad for Europe.

rabernat avatar May 11 '20 17:05 rabernat

I'd prefer 1:00 p.m. ET, or 3:00 p.m. If we need to do European time, 11:00 a.m. ET is doable. I'm on Pacific time, myself.

rpwagner avatar May 11 '20 17:05 rpwagner

Tomorrow is pretty much shot for me but I don't think I am entirely needed here. I could do 8:30a PT or you could go on without me.

jhamman avatar May 11 '20 19:05 jhamman

Rick, why don't the two of us have a brief chat at 3pm ET. We can use https://whereby.com/pangeo. Looking forward to catching up!

rabernat avatar May 12 '20 01:05 rabernat

That works!

rpwagner avatar May 12 '20 02:05 rpwagner

Looking at my @rpwagnerbuilds repo, I saw that I was in the middle of doing a clean up and didn't add back in the scripts to actually configure and launch GCP in the container. There's a version with the scripts in my working fork. You can trace what's happening by looking at the Dockerfile.

rpwagner avatar May 14 '20 04:05 rpwagner