A3C-Doom w MultiRNNCell?

[lefnire]

trafficstars

Wondering if anyone's had success implementing a deep RNN in AC_Network()? At first glance it looks as easy as

cell = tf.nn.rnn_cell.LSTMCell(256, state_is_tuple=True)
cell = tf.nn.rnn_cell.MultiRNNCell([cell] * 2, state_is_tuple=True)
# same stuff as before

but the output is now a tuple of tuples, which will change handling of c_in & h_in placeholders and feed_dicts throughout Worker(). Definitely a support request rather than bug, just I've tried my hand at this for a couple days & my newbiness is blocking me.