BirdSet
BirdSet copied to clipboard
Tutorial: add Model training section
Add a section to the tutorial to train and evaluate a simple NN (efficientnet). Including visualization of audio input, spectrogram, NN output and transformation of output to class name.
This involves the following steps:
- Load
BaseModulewithmodelparameter asefficientnet.py- for this, the
hydra.initiatecall needs to be removed and the model parameter should be typed as an object (see how it is done in theGADMEDatamodule)
- for this, the
- train using lightning trainer
- eval using lightning trainer
- use trained model for prediction of a test sample
- load a single sample from test dataset
- visualize waveform, make audio listenable in notebook
- convert to spectrogram using test dataloader (make sure its the same sample, could be done with disabling random sampling of the dataloader ?)
- feed into trained network
- convert output to class label name
@tom2208 @jonathanschirp @PariaValizadeh That could be a good task for you! First try the stuff I mentioned in notion and then tackle this issue!