cmarlin

Hi, the wrap_env function allow to mix a time limit with auto_reset disabled, but TimeLimit reset environment without checking this flag. Note: it seems that TimeLimit implementation mismatch documentation, as...

Hello, The tf.function decorator on function per_field_where (in file tf_agents/utils/nest_utils.py) generates a tensorflow warning: `WARNING:tensorflow:5 out of the last 8 calls to triggered tf.function retracing. Tracing is expensive and the...