NEKO

NEKO copied to clipboard

Atari Datasets

1

This issue does not go into all the detail regarding our dataset considerations, but I am currently converting datasets for 45 Atari games to Minari. I utilize dqn-replay, which in...

daniellawson9999

Make this in parallel: https://github.com/ManifoldRG/gato-control/blob/0f4f7d2c8a31ca1e6a6e85a6d3f0d763910bfb39/gato/training/trainer.py#L148-L165 and potentially Minari's own function: https://github.com/Farama-Foundation/Minari/blob/c0669fc3a8829dec4a7a1fbee198a6be4f668ea1/minari/dataset/minari_storage.py#L153 When training on several games w/ image observations (Atari) the training loop is too slowed and is being dominated...

daniellawson9999

Performed: - 3 MuJoCo tasks - Breakout (on a small, relatively arbitrary subset of steps converted to Minari) What's next __imediately__: - Convert more Atari data to Minari (The details...

daniellawson9999

Gato's prompting for control tasks:  We follow this general strategy, but fill the gaps as some details are not specified. Let's look at some arguments related to prompting in...

daniellawson9999

Let's look at tokenize_input_dicts https://github.com/ManifoldRG/gato-control/blob/2deb510246ebd6b13dd53199f8de7df4e0b96f34/gato/policy/gato_policy.py#L193-L211 to https://github.com/ManifoldRG/gato-control/blob/2deb510246ebd6b13dd53199f8de7df4e0b96f34/gato/policy/gato_policy.py#L408 which is utilized in GatoPolicy.forward for embedding inputs before passing them to the transformer. This function takes a list of dictionaries as input,...

daniellawson9999

This PR fixes the perplexity bug that has been haunting NEKO for months! :)

bhavul

In an effort to decrease the training loss of VQA task, we are experimenting another ViT, timm ViT, this is a pre-trained ViT. So far the test shows that VQA...

henryj18