Try GPT2 with RGA for amazing results

[asigalov61]

Извините за Аншлийский, но так проще...

Here you go, guys,

Provided implementation should show amazing results with your awesome programming and AI skills.

The right dataset is also the key so consider using something like this: https://github.com/asigalov61/Tegridy-MIDI-Dataset/tree/master/Ultimate-Piano-MIDI

Please note that Google Music Transformer results ARE NOT REPRODUCIBLE !!! And as I mentioned above Google's architecture is not capable of nice and smooth continuations (which is what you would really need) unlike GPT2, especially with RGA!

Thank you and please let me know what you think.

Alex

[max-unfinity]

Hi, Alex! Thanks for activity! Could you explain why you think GPT-2 will be better than Music Transformer? Both models are Generative Transformers with RPR/RGA. They practically do same things. I think we get better results with trying new encoding methods or/and collecting realy big MIDI dataset.

btw, what is the Ultimate-Piano-MIDI dataset? Is it your own?