vector-quantize-pytorch
vector-quantize-pytorch copied to clipboard
lucidrains
[Feature request] Implement dead code revival
hey! do you have a link to the paper with this technique?
Hey, sorry about the lack of details, I wanted to add more context but completely forgot about it! I'm not really sure about which was the first paper that used this technique, but I'd say is this one: https://arxiv.org/pdf/2005.00341.pdf
@jordiae the new improved vqgan has some tips too! https://openreview.net/forum?id=pfNyExj7z2 section 3.2
@jordiae let me implement these two tweaks from the improved VQGAN paper, then i can look at the jukebox method
@jordiae Hey Jordi! Implemented both of the proposals from the VQGan paper in 0.3.1 and 0.3.2 - let me know if they work for you. I'll also try implementing the dead code revival technique from the soundstream paper, brought up by Wes in the other issue
@jordiae Hey Jordi! Implemented both of the proposals from the VQGan paper in 0.3.1 and 0.3.2 - let me know if they work for you. I'll also try implementing the dead code revival technique from the soundstream paper, brought up by Wes in the other issue
Cool! Thanks!
@jordiae can't guarantee it is :bug: free though :rofl: lemme know how it fares