cloud_science icon indicating copy to clipboard operation
cloud_science copied to clipboard
verified publisher icon cgentemann

add mur

Open cgentemann opened this issue 5 years ago • 4 comments

In this repository there is a Access_MUR_SST_example.ipynb that shows how to read AWS MUR global SST. update tutorial to use MUR SST from AWS. to do this, you may need to open a dask cluster.
@caitlinkroeger

cgentemann avatar Sep 21 '20 21:09 cgentemann

Hi, Gentemann I met a error when I tried to run the code below. gateway= Gateway() cluster = gateway.new_cluster() cluster.adapt(minimum=1, maximum=20) client = Client(cluster)

issue

Should I paste a url to the Gateway() ? Maybe, I do not have a dash goup?

LiNinghui-AI avatar Oct 29 '20 03:10 LiNinghui-AI

Hi! Thanks for looking @ my code --- in this notebook is stuff I'm usually working on developing. If you are interested in MUR SST AWS I would use https://github.com/pangeo-gallery/osm2020tutorial which gives you a AWS binder option that has a DASK cluster install. Please let me know if you have any other issues. The Dask gateway call has recently changed and I haven't checked to see if the older image still works in a while.

cgentemann avatar Oct 29 '20 03:10 cgentemann

Hi! Thanks for looking @ my code --- in this notebook is stuff I'm usually working on developing. If you are interested in MUR SST AWS I would use https://github.com/pangeo-gallery/osm2020tutorial which gives you a AWS binder option that has a DASK cluster install. Please let me know if you have any other issues. The Dask gateway call has recently changed and I haven't checked to see if the older image still works in a while.

Thanks for your reply, I deal with the data successsfully by Pangeo which is using Jupyterlab, can data download only by writing code ? Is it possible for me to create my own cloud storage space for uploading and downloading data?

LiNinghui-AI avatar Oct 29 '20 08:10 LiNinghui-AI

You can download MUR SST data from https://podaac.jpl.nasa.gov/ The Pangeo binder is a containerized version of the code. You can run the code in the tutorial or your own, but it is just a temporary image, so you must download any results/code before you are finished. If you need access to the cloud and storage you can look into different solutions... it varies by how you are funded, but I'd start by asking around colleagues. One solution to running large analyses locally, but using a Dask cluster on the cloud is coiled... https://cloud.coiled.io/

cgentemann avatar Oct 29 '20 17:10 cgentemann