Gaon An

Asterix/1 dataset broken?

3

Hi, I tried reproducing the offline REM results with Asterix/1 dataset by using the command below: ``` python -um batch_rl.fixed_replay.train \ --base_dir=/tmp/batch_rl \ --replay_dir=/data_large/readonly/atari/Asterix/1 \ --agent_name=multi_head_dqn \ --gin_files='batch_rl/fixed_replay/configs/rem.gin' \ --gin_bindings='FixedReplayRunner.num_iterations=1000'...

Some minor changes in cql.py to resolve https://github.com/aviralkumar2907/CQL/issues/5

IQL results different with the paper

1

Hi, The IQL results from this repo seem to differ from the original paper. According to the README of the IQL example code here, IQL scores an average raw return...