How do you prevent from quality degradation in autoregressive generation?

[xizaoqu]

Thanks for your interesting work. Intuitively, autoregressive generation may result in poor quality after some iterations, which is also reflected in my experiments on this project. But I noticed that the video on your YouTube suffers little on this issue. Do you use some tricks?