transframer-pytorch icon indicating copy to clipboard operation
transframer-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

You are right!

Open Mut1nyJD opened this issue 2 years ago • 1 comments

The only semi new thing is the DCT but even that I think is not completely new either. I thought there was already a generative model that did that not sure if it was autoregressive though.

But I guess the rational is that DCT is better than any learned quantized fixed length encoder and it saves you training an encoder.

Mut1nyJD avatar Aug 23 '22 15:08 Mut1nyJD