Mava icon indicating copy to clipboard operation
Mava copied to clipboard

Published 20 hours ago • verified publisher icon instadeepai

Origin/feature/jax systems step counter for executor

Open nima-siboni opened this issue 2 years ago • 0 comments

What?

A counter for the steps of the executor is added.

Why?

The number of steps taken is relevant for some parts of an RL solution, for example the epsilon scheduler for exploration could be tiemstep dependent.

How?

steps_count is added to the store of the executor.

Extra

Related to issue #498

nima-siboni avatar May 06 '22 10:05 nima-siboni