unconf17 icon indicating copy to clipboard operation
unconf17 copied to clipboard

R package to retrieve NASA datasets 🛰

Open jimhester opened this issue 7 years ago • 17 comments

Basically an R port of https://github.com/bmtgoncalves/pyNASA, seems a pretty natural fit for rOpenSci

jimhester avatar Apr 29 '17 13:04 jimhester

Calling all #NASADatanauts! @jasdumas @ldecicco-USGS @AmeliaMN @eringrand @LucyMcGowan

stefaniebutland avatar Apr 30 '17 17:04 stefaniebutland

yes! this has been on my todo list probably pulling from here: https://data.nasa.gov/browse?limitTo=datasets 🚀

LucyMcGowan avatar Apr 30 '17 18:04 LucyMcGowan

Yes!

Apologies for any typos.

On Apr 30, 2017, at 2:16 PM, LucyMcGowan [email protected] wrote:

yes! this has been on my todo list probably pulling from here: https://data.nasa.gov/browse?limitTo=datasets 🚀

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

eringrand avatar Apr 30 '17 22:04 eringrand

Yeah, I've been looking for a way to contribute, and this is a natural fit. I've led a similar effort for USGS data (sorry for the non-unique package name...):

https://github.com/USGS-R/dataRetrieval

I can try to contribute my experience of what has worked well in that package (...and what didn't!)

ldecicco-USGS avatar May 01 '17 15:05 ldecicco-USGS

I'm not going to the Unconf but I've been talking about collaborate with this with @bmtgoncalves. Is there a way that I can be involved?

d4tagirl avatar May 02 '17 16:05 d4tagirl

@d4tagirl A couple of people have participated in the unconf remotely in the past. The key would be good communication with the project team, using something like https://appear.in/ for video chat.

stefaniebutland avatar May 02 '17 17:05 stefaniebutland

I'll stay tuned then, thank you!!

d4tagirl avatar May 03 '17 15:05 d4tagirl

I am on board! I work at a NASA data center (https://daac.ornl.gov/ ) and we could start here for the Earth science data: https://cmr.earthdata.nasa.gov/opensearch/ I would also like to talk about packages to retrieve actual data (as opposed to metadata) using webservices such as OPeNDAP. we could start here: https://thredds.daac.ornl.gov/thredds/catalogs/ornldaac/ornldaac.html

alisonboyer avatar May 03 '17 16:05 alisonboyer

Count me in for this! @alisonboyer, I agree retrieving actual data would be even more interesting

cvitolo avatar May 15 '17 21:05 cvitolo

I had started working on this package interfacing the NASA API of MODIS Level 1 and Atmosphere data products. Not sure how much it overlaps with other datasets presented here, maybe not at all? In any case, if anyone is interested, I can move it to ropenscilabs for the unconf.

maelle avatar May 16 '17 15:05 maelle

@maelle Your LAADS package looks cool. This is exactly the type of package that we need. The MODISTools package was my inspiration, and I think we need multiple packages to hit different data.

alisonboyer avatar May 16 '17 15:05 alisonboyer

Cool, happy to collaborate! MODISTools has a slightly misleading name IMO since it doesn't hit all MODIS data 😊

maelle avatar May 16 '17 15:05 maelle

We use raadsync to download data from a variety of sources via different methods (mostly wget) and includes remote sensing files from the NASA ocean colour website:

https://github.com/AustralianAntarcticDataCentre/raadsync

It's not polished sufficiently for general use but it's not hard to set up and it's proven to work very well - we'd appreciate any feedback or interest in it. We register datasets in JSON with the information required about how to discover new/changed files, the download method, whether unpacking is required after download.

mdsumner avatar May 19 '17 01:05 mdsumner

@alisonboyer regarding opendap, been trying to get an opendap client dappr https://github.com/ropensci/dappr to a useable state for a while - could be part of this

sckott avatar May 19 '17 03:05 sckott

@sckott nice! yes, that is a good idea

alisonboyer avatar May 19 '17 16:05 alisonboyer

i'm so sorry to miss the unconf this year. If you all decide to pursue this topic will you loop me in via video chat? I really would love to contribute

alisonboyer avatar May 24 '17 17:05 alisonboyer

Hi everyone (and @jimhester and @d4tagirl in particular)

Thank you for the interest in pyNASA. While I'm fairly comfortable using R, I've never tried writing a package. If there's anything I can do to help, just let me know!

Best

B

bmtgoncalves avatar May 25 '17 20:05 bmtgoncalves