Peter Dudfield
Peter Dudfield
## Detailed Description Currently the nwp filename is 'nwp_zarr_path' but it in fact can be a 'netcdf' file once this PR (#581) has happened The pydantic model file is [here](https://github.com/openclimatefix/nowcasting_dataset/blob/main/nowcasting_dataset/config/model.py#L294)...
## Detailed Description Download pv output.org dataset for 2020 and 2021 ## Context This will allow #562 to be tested properly
## Detailed Description Remove renaming of x and y coorindate once 1. https://github.com/openclimatefix/Satip/issues/42 2. https://github.com/openclimatefix/nwp/issues/9 ## Context good to clear up code
## Detailed Description Make sure x and y center from metadata are aligned with GSP id ## Context Useful for fake data to represent real data ## Possible Implementation Options...
## Detailed Description - Move imports to top of file - solve circular imports issue ## Context https://github.com/openclimatefix/nowcasting_dataset/pull/314#discussion_r762892363 code is [here](https://github.com/openclimatefix/nowcasting_dataset/blob/jacob/optical-flow-datasource/nowcasting_dataset/data_sources/optical_flow/optical_flow_data_source.py#L73)
## Detailed Description values where hard coded as part of https://github.com/openclimatefix/nowcasting_dataset/issues/390 and #424 Would be good to move - train_test_validation_split - train_validation_test_datetime_split to the config model file ## Context Useful...
**Describe the bug** If only train csv file has been created then it assumes the validation and test are also there [code](https://github.com/openclimatefix/nowcasting_dataset/blob/main/nowcasting_dataset/manager.py#L209) **To Reproduce** Steps to reproduce the behavior: 1....
## Detailed Description Remove SAT_FILENAME from consts SAT_FILENAME however seems to be used in two places: 1. [here](https://github.com/openclimatefix/nowcasting_dataset/blob/8e85735dbd26dbd517b4bf2b3495de1d3e99b8a5/conftest.py#L34) 2. [here](https://github.com/openclimatefix/nowcasting_dataset/blob/8e85735dbd26dbd517b4bf2b3495de1d3e99b8a5/scripts/generate_data_for_tests/generate_satellite_test_data.py#L22) ## Context Good to get rid of stuff not used...
## Detailed Description Would be useful to have a method to drop 'padded' pv systems. These are padding out zero so that the dataset can be save in an efficient...
Remove background satellite image ## Detailed Description Remove background of satellite image by looking at the last 30 days, and removing the mean/min/max or max value. This should be time...