openl3 icon indicating copy to clipboard operation
openl3 copied to clipboard

Extract activation from lower audio layers

Open seunggookim opened this issue 2 years ago • 1 comments

Hi, I was wondering how I can extract activations from the lower audio layers. I guess "embeddings" are the same as "MaxPool_3"? and if that's correct, then "MaxPool", "MaxPool_1", and "MaxPool_2" corresponds to the first, second, and third max-pooling layers in the Audio ConvNet as explained in Arandjelovic and Zisserman 2018 (https://arxiv.org/abs/1712.06651)?

seunggookim avatar Jun 15 '22 14:06 seunggookim

That sounds right! You should be able to construct a new model stopping at the appropriate level and selectively load the model weights up to that layer from the existing ones. If you wanted, you could also swap out the output max pooling layer if you wanted to play around with further downsampling the embedding.

auroracramer avatar Jul 01 '22 20:07 auroracramer