recurrent-memory-transformer-pytorch
recurrent-memory-transformer-pytorch copied to clipboard
have you had a chance to train it yet?
ive got a few days of full access to a cluster of about 8a6000s and im itching to put them to some insane task, i hadnt even considered this but i really want to ensemble this and see what happens in an extremely accelerated environment
hey! only the enwik8 example in the repository
you should give it a try!
i know youre extremely busy, so i dont expect your interest (though it would be massively welcome) - im engaging in a project with a wide scope and some amount of funding and interest. some elements of the workflow, will involve this repository so it felt wrong to ask if you would like to be involved to whatever degree of was convenient for you