batch_rl icon indicating copy to clipboard operation
batch_rl copied to clipboard

Published 20 hours ago • verified publisher icon google-research

TF Version must < 2.0?

Open weihongwei0586 opened this issue 4 years ago • 4 comments

The code cant work in my environment where TF version is the newest(2.2.0). because the tf.contrib moudle has been removed?

weihongwei0586 avatar Jul 21 '20 09:07 weihongwei0586

Yeah, I think Dopamine library still uses tensorflow 1.x and the code is only compatible with that for now :/ . @psc-g for visibility about dopamine.

agarwl avatar Jul 21 '20 15:07 agarwl

we're working on both a jax version of dopamine and a TF2 compliant version, stay tuned!

psc-g avatar Jul 21 '20 15:07 psc-g

we're working on both a jax version of dopamine and a TF2 compliant version, stay tuned!

Thank you very much!

weihongwei0586 avatar Jul 21 '20 15:07 weihongwei0586

Dopamine now supports JAX agents! The main difference in offline agents is to simply use the FixedReplayBuffer (which directly reads data from numpy) instead of the tensorflow buffer. For an example, see the implementation of QR-DQN in JAX.

agarwl avatar Nov 24 '20 08:11 agarwl