agents icon indicating copy to clipboard operation
agents copied to clipboard

DQN sample - AverageReturn output is same as AverageEpisodeLength

Open maxima120 opened this issue 2 years ago • 0 comments

I have ran sample: https://github.com/tensorflow/agents/tree/942db59044f2b25151f313dc9a098ff652ab90f2/tf_agents/agents/dqn/examples/v2

Apparently AverageReturn always equal AverageEpisodeLength. Potential bug?

INFO:absl: 
		 AverageReturn = 119.5999984741211
		 AverageEpisodeLength = 119.5999984741211
INFO:absl:step = 3000, loss = 2.203988
INFO:absl:403.487 steps/sec

maxima120 avatar Sep 23 '22 18:09 maxima120