staged-recipes icon indicating copy to clipboard operation
staged-recipes copied to clipboard

Proposed Recipes for NOAA/NSIDC Climate Data Record of Passive Microwave Sea Ice Concentration

Open rabernat opened this issue 3 years ago • 7 comments

Source Dataset

This data set provides a Climate Data Record (CDR) of sea ice concentration from passive microwave data. The CDR algorithm output is a rule-based combination of ice concentration estimates from two well-established algorithms: the NASA Team (NT) algorithm (Cavalieri et al. 1984) and NASA Bootstrap (BT) algorithm (Comiso 1986). The CDR is a consistent, daily and monthly time series of sea ice concentrations from 25 October 1978 through the most recent processing for both the north and south polar regions. All data are on a 25 km x 25 km grid.

  • Link to the website / online documentation for the data: https://nsidc.org/data/G02202/versions/4
  • The file format (e.g. netCDF, csv): netCDF
  • How are the source files organized? (e.g. one file per day): not sure
  • How are the source files accessed (e.g. FTP): FTP - ftp://sidads.colorado.edu/DATASETS/NOAA/G02202_V4/
  • Any special steps required to access the data (e.g. password required): Registration required

Transformation / Alignment / Merging

None

Output Dataset

One Zarr each for northern and southern hemisphere

cc @stb2145 - This would be useful for your project

rabernat avatar Aug 27 '21 17:08 rabernat

FYI NOAA has made this data available via the BDP. AWS link: https://registry.opendata.aws/noaa-cdr-oceanic/

zflamig avatar Aug 27 '21 18:08 zflamig

Amazing! Then we could do a Reference recipe and not even copy any data!

URLs look like this: s3://noaa-cdr-sea-ice-concentration-pds/data/1980/seaice_conc_daily_nh_n07_19800101_v02r00.nc

import xarray as xr
impor s3fs
fs = s3fs.S3FileSystem(token='anom')
file_url = 's3://noaa-cdr-sea-ice-concentration-pds/data/1980/seaice_conc_daily_nh_n07_19800101_v02r00.nc'
ds = xr.open_dataset(fs.open(file_url), engine='h5netcdf')
print(ds)
<xarray.Dataset>
Dimensions:                         (time: 1, ygrid: 448, xgrid: 304)
Coordinates:
  * time                            (time) datetime64[ns] 1980-01-01
  * ygrid                           (ygrid) float32 5.838e+06 ... -5.338e+06
  * xgrid                           (xgrid) float32 -3.838e+06 ... 3.738e+06
    latitude                        (ygrid, xgrid) float64 ...
    longitude                       (ygrid, xgrid) float64 ...
Data variables:
    projection                      |S1 ...
    seaice_conc_cdr                 (time, ygrid, xgrid) float32 ...
    stdev_of_seaice_conc_cdr        (time, ygrid, xgrid) float32 ...
    melt_onset_day_seaice_conc_cdr  (time, ygrid, xgrid) float32 ...
    qa_of_seaice_conc_cdr           (time, ygrid, xgrid) float32 ...
    goddard_merged_seaice_conc      (time, ygrid, xgrid) float32 ...
    goddard_nt_seaice_conc          (time, ygrid, xgrid) float32 ...
    goddard_bt_seaice_conc          (time, ygrid, xgrid) float32 ...
Attributes: (12/42)
    Conventions:               CF-1.6
    title:                     NOAA/NSIDC Climate Data Record of Passive Micr...
    references:                Comiso, J. C., and F. Nishio. 2008. Trends in ...
    cdr_program:               NOAA Climate Data Record Program
    cdr_variable:              seaice_conc_cdr
    software_version_id:       svn+ssh://newice.colorado.edu/SubversionReposi...
    ...                        ...
    platform:                  NIMBUS-7
    sensor:                    SMMR > Scanning Multichannel Microwave Radiometer
    date_created:              2013-05-22T19:14:28Z
    time_coverage_start:       1980-01-01T00:00:00Z
    time_coverage_end:         1980-01-01T23:59:59Z
    comment:                   The variables seaice_conc_cdr, stdev_of_seaice...

rabernat avatar Aug 27 '21 18:08 rabernat

Looking at the bucket s3://noaa-cdr-sea-ice-concentration-pds for Passive Microwave Sea Ice Concentration, data only appears to available through 2015. My understanding from the CDR docs is that this dataset has been produced through present? @Patrick-Keown is there a good point of contract for this CDR distribution that we can ask about the distribution date range in the S3 bucket?

sharkinsspatial avatar Oct 20 '22 18:10 sharkinsspatial

Hi Sean,

Let me get the right POC for this specific dataset and get back to you.

Thanks,

Patrick Keown

Program Manager, NOAA Open Data Dissemination (NODD)

Office of the Chief Information Officer (OCIO)

National Oceanic & Atmospheric Administration

(615) 319-5906 | @.***

"Be sure when you step, step with care and great tact" - Dr. Seuss

On Thu, Oct 20, 2022 at 2:16 PM Sean Harkins @.***> wrote:

Looking at the bucket s3://noaa-cdr-sea-ice-concentration-pds for Passive Microwave Sea Ice Concentration, data only appears to available through 2015. My understanding from the CDR docs is that this dataset has been produced through present? @Patrick-Keown https://github.com/Patrick-Keown is there a good point of contract for this CDR distribution that we can ask about the distribution date range in the S3 bucket?

— Reply to this email directly, view it on GitHub https://github.com/pangeo-forge/staged-recipes/issues/73#issuecomment-1285958135, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOISIED6A3HSOYM2W64GWPDWEGD6PANCNFSM5C6AEFWA . You are receiving this because you were mentioned.Message ID: @.***>

Patrick-Keown avatar Oct 21 '22 13:10 Patrick-Keown

Hi Sean,

For Passive Microwave Sea Ice Concentration CDR questions, please contact the team at @.***

Thanks,

Patrick Keown

Program Manager, NOAA Open Data Dissemination (NODD)

Office of the Chief Information Officer (OCIO)

National Oceanic & Atmospheric Administration

(615) 319-5906 | @.***

"Be sure when you step, step with care and great tact" - Dr. Seuss

On Fri, Oct 21, 2022 at 9:15 AM Patrick Keown - NOAA Federal < @.***> wrote:

Hi Sean,

Let me get the right POC for this specific dataset and get back to you.

Thanks,

Patrick Keown

Program Manager, NOAA Open Data Dissemination (NODD)

Office of the Chief Information Officer (OCIO)

National Oceanic & Atmospheric Administration

(615) 319-5906 | @.***

"Be sure when you step, step with care and great tact" - Dr. Seuss

On Thu, Oct 20, 2022 at 2:16 PM Sean Harkins @.***> wrote:

Looking at the bucket s3://noaa-cdr-sea-ice-concentration-pds for Passive Microwave Sea Ice Concentration, data only appears to available through 2015. My understanding from the CDR docs is that this dataset has been produced through present? @Patrick-Keown https://github.com/Patrick-Keown is there a good point of contract for this CDR distribution that we can ask about the distribution date range in the S3 bucket?

— Reply to this email directly, view it on GitHub https://github.com/pangeo-forge/staged-recipes/issues/73#issuecomment-1285958135, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOISIED6A3HSOYM2W64GWPDWEGD6PANCNFSM5C6AEFWA . You are receiving this because you were mentioned.Message ID: @.***>

Patrick-Keown avatar Oct 21 '22 15:10 Patrick-Keown

@Patrick-Keown On Github issues, all email address are obfuscated so I'm not actually able to see the contact you included. Do any of these contact points have a Github handle you can use as a point of contact?

sharkinsspatial avatar Oct 21 '22 19:10 sharkinsspatial

Sean,

Unfortunately not. Can you contact me via our team email. That can be found on the CDR Roda Page. It is the NODD contact email.

Patrick Keown

Program Manager, NOAA Open Data Dissemination (NODD)

Office of the Chief Information Officer (OCIO)

National Oceanic & Atmospheric Administration

(615) 319-5906 | @.***

"Be sure when you step, step with care and great tact" - Dr. Seuss

On Fri, Oct 21, 2022 at 3:32 PM Sean Harkins @.***> wrote:

@Patrick-Keown https://github.com/Patrick-Keown On Github issues, all email address are obfuscated so I'm not actually able to see the contact you included. Do any of these contact points have a Github handle you can use as a point of contact?

— Reply to this email directly, view it on GitHub https://github.com/pangeo-forge/staged-recipes/issues/73#issuecomment-1287359685, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOISIEFG66GTSNUNDUZPSIDWELVULANCNFSM5C6AEFWA . You are receiving this because you were mentioned.Message ID: @.***>

Patrick-Keown avatar Oct 25 '22 18:10 Patrick-Keown