RL-Implementation-IMPALA icon indicating copy to clipboard operation
RL-Implementation-IMPALA copied to clipboard

Published 20 hours ago • verified publisher icon ducandu

implementation with v-trace?

Open PaulConyngham opened this issue 7 years ago • 2 comments

hey mate - recon you might be able to have another crack at this with v-trace implemented?

Recently saw a talk at this years ICLR explaining how v-trace works:

https://youtu.be/N5oZIO8pE40?t=26m54s

PaulConyngham avatar May 10 '18 23:05 PaulConyngham

Hi Paul, Thanks for sharing the talk. I'm very sorry, but I will not have the time to implement the V-trace into this repo. However, please check out our newest RL-library (still in an early dev/pre-pre-alpha state), here on github: https://github.com/YARL-project/YARL This one will - probably in a few months - have a full IMPALA implementation including distributed computation and multi-GPU support. Best, Sven

sven1977 avatar May 17 '18 09:05 sven1977

wow, the ML community is honestly amazing - will check back here in a couple of months good luck Sven & keep us posted !

PaulConyngham avatar May 17 '18 11:05 PaulConyngham