Recording your own experiences to augment the dataset

[lugi7]

Hi, is there a possibility to add your own experiences to the dataset? The best way I can think of right now would be some sort of recording playing minecraft through MALMO, but maybe there is some sort of script published already, preferably the same one that was used to construct the MineRL dataset from human demonstrations.

[Miffyli]

There are bits of the script that were used to render the dataset in this repo, yes, but the setup is rather convoluted (uses normal Minecraft with a recording mod etc). In a smaller scale, what I guess you are doing, it may be easier to build up on MineRL to record the videos. You will also get the nice benefit of having exactly same observations and actions without any additional preprocessing.

You could use this script as a starting point (play Minecraft through MineRL).