xcdat icon indicating copy to clipboard operation
xcdat copied to clipboard

[Doc]: Issue opening up ESGF datasets hosted on LLNL servers via OPeNDAP

Open tomvothecoder opened this issue 1 year ago • 2 comments

Describe your documentation update

There is an issue opening up ESGF datasets from LLNL nodes that is probably affecting all of our gallery documentation.

I think this might have to do with the THREDDS catalog being disabled? Although it was working fine recently until today, and HTTP downloads still work fine.

  • https://aims3.llnl.gov/thredds/catalog/catalog.html
  • https://esgf-data1.llnl.gov/thredds/catalog/catalog.html
  • https://esgf-data2.llnl.gov/thredds/catalog/catalog.html

MVCE

import xcdat as xc

dpath = "https://esgf-data1.llnl.gov/thredds/dodsC/css03_data/CMIP6/CMIP/CSIRO/ACCESS-ESM1-5/historical/r10i1p1f1/Amon/tas/gn/v20200605/tas_Amon_ACCESS-ESM1-5_historical_r10i1p1f1_gn_185001-201412.nc"

xc.open_dataset(dpath)

Log

syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: 404^ page not found

...

OSError: [Errno -90] NetCDF: file not found: 'https://esgf-data1.llnl.gov/thredds/dodsC/css03_data/CMIP6/CMIP/CSIRO/ACCESS-ESM1-5/historical/r10i1p1f1/Amon/tas/gn/v20200605/tas_Amon_ACCESS-ESM1-5_historical_r10i1p1f1_gn_185001-201412.nc'

Workaround

Use replica datasets hosted at other sites with OPeNDAP support.

tomvothecoder avatar Jul 02 '24 21:07 tomvothecoder

Any ideas @xCDAT/core-developers? I can reach out to Sasha too.

tomvothecoder avatar Jul 02 '24 21:07 tomvothecoder

I think Sasha is probably the best bet for quickly figuring this out.

pochedls avatar Jul 02 '24 22:07 pochedls

Closed with #705, which replaces xCDAT documentation references to ESGF OPenDAP datasets with https://github.com/xCDAT/xcdat-data.

tomvothecoder avatar Jun 30 '25 18:06 tomvothecoder