spark-xarray
spark-xarray copied to clipboard
This is an experimental project that seeks to integrate PySpark and xarray for Climate Data Analysis.
The Bias correction workflow will follow the following steps adapted from [Downscale Paper doc](https://paper.dropbox.com/doc/Downscale-g33mdck7FPAd1iYHvBVHL) - [ ] Prepare data - [ ] Gather tavg, tmin, tmax, pr data: - [...
## Bias Correction Process - Moving Window - to handle seasonality - Normalize data - recenter (```mean 0```) - rescale ( ```sd 1```) - detrend - transform to deskew (e.g.,...
- [ ] Create a separate function for single and multi modes that calls ```xarray.open_dataset()``` and ```xarray.open_mfdataset()``` respectively. - [ ] After this, have single and multi modes use same...
@andersy005 @kmpaul Can you please make a release so we can officially install this on Cheyenne? CISL can't install unreleased software. If you haven't worked with releases with git, it's...