thredds icon indicating copy to clipboard operation
thredds copied to clipboard

FMRC offsetsGreaterEqual still not working in TDS 4.6.11

Open pacioos opened this issue 7 years ago • 0 comments

While it was previously reported that this was fixed in TDS 4.6, I still cannot see any change in my NCSS output for an FMRC dataset with or without the offsetsGreaterEqual setting. We have wanted this to work so that the model "spin-up" period (i.e., the first several hours of any forecast run) can be ignored in our aggregations. Otherwise, we see obvious regular "dips" in our time series plots during these spin-up periods. For example, in significant wave heights from our wave forecasts. You can see what I mean in this comparison of the standard "Best Time Series" NCSS output vs. my "Testing" NCSS output with offsetsGreaterEqual to 10 (I have tried other numbers). If you diff the csv of these two outputs, they are identical. If you plot them, you'll see the dips in wave height that we're trying to remove:

SWAN Oahu FMRC catalog: http://oos.soest.hawaii.edu/thredds/catalog/hioos/model/wav/swan/oahu/catalog.html

Best Time Series NCSS output: http://oos.soest.hawaii.edu/thredds/ncss/grid/hioos/model/wav/swan/oahu/SWAN_Oahu_Regional_Wave_Model_best.ncd?accept=csv&point=true&var=shgt&latitude=21.348701&longitude=-158.187173&time_end=2018-02-13T00:00:00&time_start=2018-02-01T00:00:00

"Testing" NCSS output for the same time period and lat/lon point using offsetsGreaterEqual=10: http://oos.soest.hawaii.edu/thredds/ncss/grid/hioos/model/wav/swan/oahu/SWAN_Oahu_Regional_Wave_Model_Testing?accept=csv&point=true&var=shgt&latitude=21.348701&longitude=-158.187173&time_end=2018-02-13T00:00:00&time_start=2018-02-01T00:00:00

Also, you'll notice the "Testing" (offsetsGreaterEqual) output takes significantly longer to run compared to the standard Best Time Series: ~30 seconds compared to <1 second. This slowness also needs addressing.

Thanks for giving this another look. Please contact me if you'd like me to provide some sample files to test against. Cheers, John Maurer Data System Engineer Pacific Islands Ocean Observing System (PacIOOS) University of Hawaii at Manoa

pacioos avatar Feb 14 '18 19:02 pacioos