BirdSet icon indicating copy to clipboard operation
BirdSet copied to clipboard

Tutorial: add Model training section

Open raphaelschwinger opened this issue 1 year ago • 1 comments

Add a section to the tutorial to train and evaluate a simple NN (efficientnet). Including visualization of audio input, spectrogram, NN output and transformation of output to class name.

This involves the following steps:

  • Load BaseModule with model parameter as efficientnet.py
    • for this, the hydra.initiate call needs to be removed and the model parameter should be typed as an object (see how it is done in the GADMEDatamodule)
  • train using lightning trainer
  • eval using lightning trainer
  • use trained model for prediction of a test sample
    • load a single sample from test dataset
    • visualize waveform, make audio listenable in notebook
    • convert to spectrogram using test dataloader (make sure its the same sample, could be done with disabling random sampling of the dataloader ?)
    • feed into trained network
    • convert output to class label name

raphaelschwinger avatar Mar 08 '24 09:03 raphaelschwinger

@tom2208 @jonathanschirp @PariaValizadeh That could be a good task for you! First try the stuff I mentioned in notion and then tackle this issue!

raphaelschwinger avatar Mar 08 '24 10:03 raphaelschwinger