nowcasting_dataset

nowcasting_dataset copied to clipboard

Add map to each ML training example showing location of installed PV systems

1

## Detailed Description At the moment, for each ML example, we ask our ML models to directly predict total solar PV power generation for an entire _region_ of the country...

JackKelly

Try MyPy

1

## Detailed Description Try automatically running MyPy on this code, to do static analysis We might want to turn off a bunch of the less interesting warnings / errors :)

JackKelly

After #213 is implemented, we should check to see if `DataSource` really needs `history_len`, `forecast_len`, `_total_seq_len`, `_total_seq_dur`, `_history_dur` and `_forecast_dur`. It's possible that some are no longer needed :slightly_smiling_face: `_total_seq_len`...

JackKelly

https://pytorch.org/docs/stable/named_tensor.html See [this twitter conversation](https://twitter.com/jack_kelly/status/1446475674319994887). In particular, try [extending xarray with a little "accessor" extension](http://xarray.pydata.org/en/stable/internals/extending-xarray.html) like `dataarray.torch.to_tensor()` (as [suggested by Joe Hamman on Twitter](https://twitter.com/HammanHydro/status/1446593959715696640)!) And see [Joe's pull request, which...

JackKelly

When the training target is half-hourly GSP-level PV, tell the model how many minutes into the future each target is

6

## Detailed Description Up until the recent introduction of GSP-level PV into `nowcasting_dataset`, we've been dealing entirely with 5-minutely datasets. GSP-level PV is (for now, at least) half-hourly. But, if...

JackKelly

Add measurements of air quality

2

## Detailed Description Polution, water vapour, aerosols, etc. all affect the passage of sunlight through the atmosphere. Aerosols are mostly (completely?) invisible to EUMETSAT SEVIRI. So it'd be great to...

JackKelly

Create a proportion of examples without PV data, outside the UK

5

We currently only have PV data for the UK. We will at some point want to get PV data for elsewhere but, in the meantime, we'll need nowcasting_dataset to optionally...

JackKelly

Albedo satellite method

3

Remove background satellite image ## Detailed Description Remove background of satellite image by looking at the last 30 days, and removing the mean/min/max or max value. This should be time...

peterdudfield

JackKelly

Make video of data

2

v1: Take satelight patch and plot data on it. Might have to overlap a static map on the background. v2: Add nwp data on top

peterdudfield