trajectory_writer() got an unexpected keyword argument 'get_signature_timeout_ms'

[JinTian0717]

In 7_SAC_minitaur_tutorial.ipynb: rb_observer = reverb_utils.ReverbAddTrajectoryObserver( reverb_replay.py_client, table_name, sequence_length=2, stride_length=1)

TypeError Traceback (most recent call last) in () 2 reverb_replay.py_client, 3 table_name, ----> 4 sequence_length=2)

/usr/local/lib/python3.7/dist-packages/tf_agents/replay_buffers/reverb_utils.py in init(self, py_client, table_name, sequence_length, stride_length, priority, pad_end_of_episodes, tile_end_of_episodes) 335 # sequences. 336 self._writer = py_client.trajectory_writer( --> 337 num_keep_alive_refs=sequence_length + 1, get_signature_timeout_ms=None) 338 self._cached_steps = 0 339 self._last_trajectory = None

TypeError: trajectory_writer() got an unexpected keyword argument 'get_signature_timeout_ms'

[raoulraft]

I'm getting the same error in DQN Tutorial.ipynb

[barmanroys]

I am getting the same bug while following the reinforcement learning tutorial.

The culprit is this line

rb_observer = reverb_utils.ReverbAddTrajectoryObserver(
  replay_buffer.py_client,
  table_name,
  sequence_length=2)

As a rather beginner in DQN, a lot of these classes are kinda blackbox to me. So seems I have to give up on this tutorial to find another working example. It throws the same error even when run in google colab.

[JinTian0717]

Hope this video helps you folks, it is from a friend of mine. 230.zip

[barmanroys]

Hope this video helps you folks, it is from a friend of mine. 230.zip

Can you point to any reference, or open source code, or even youtube video? It is a security risk to download random videos and play it.