openl3 icon indicating copy to clipboard operation
openl3 copied to clipboard

Pretrained fusion layers

Open adrienchaton opened this issue 4 years ago • 2 comments

Hi !

Thanks for providing OpenL3 as a package. I would like to ask if one could access the pretrained fusion layers, which would classify whether a pair of image/audio embeddings are matched or not.

Otherwise I would train it myself, on top of the pretrained fixed embedding extractors you provide. But as a starting point, I would take your classifier if possible.

Best

adrienchaton avatar Apr 20 '21 06:04 adrienchaton

We don't provide the fusion layers as of now. This could be something we could add in the future potentially, but right now our focus is on adding support for TF 2.x and other usability improvements, so it's hard to say whether/when we'd get to this.

justinsalamon avatar Apr 20 '21 20:04 justinsalamon

thanks for your reply

adrienchaton avatar May 14 '21 10:05 adrienchaton