I have the same problem, please let me know if you solve this

[siemanko]

Related: https://github.com/nivwusquorum/a3c

I also created a stack overflow question:

http://stackoverflow.com/questions/38963591/how-to-implement-hogwild-style-updates-in-tensorflow