metnet icon indicating copy to clipboard operation
metnet copied to clipboard

[Meta] Implement MetNet-3 Model

Open jacobbieker opened this issue 1 year ago • 4 comments

We want to implement MetNet-3 (See #54). For this, we need to do:

  • [x] #56
  • [ ] #61
  • [ ] Embedding for Sparse + Dense layers
  • [ ] ResNet blocks
  • [ ] Train script for model that matches training setup detailed in #54
  • [ ] Topographical embedding layer
  • [ ] Point-source to grid translator (from weather station to grid)
  • [ ] Add Loss Scaling

jacobbieker avatar Oct 19 '23 14:10 jacobbieker

@jacobbieker I'll start with the first task!

Raahul-Singh avatar Oct 20 '23 07:10 Raahul-Singh

Great! Thanks!

jacobbieker avatar Oct 20 '23 08:10 jacobbieker

@Raahul-Singh to check if the layer normalisation in the MaxVit and other blocks are implemented correctly.

Raahul-Singh avatar Nov 17 '23 01:11 Raahul-Singh

Note: lucidrains has open-sourced the code here: https://github.com/lucidrains/metnet3-pytorch

shermansiu avatar Dec 29 '23 02:12 shermansiu