Jurgis Pasukonis

I've hit this issue too with `tf.random.categorical`. The outputs of the exported `mlprogram` are deterministic, and the mlmodel file doesn't seem to have any random ops.

@subho406 We have tried running PPO baseline, but it was pretty much flatlining at 0.

@subho406 that's very interesting that you got reasonable results with Asynchronous PPO. Would you be able to share the results? Did you try it on all 4 sizes of memory...

That's strange, I have never noticed high RAM usage per environment. Are you sure it is the environment that is using up RAM, and not something else? The slowness of...

Please, go ahead! It would be nice to support that, but also keep the existing gym environments.

Sorry for delayed reply. You mean the maze does *not* change, but the player location does? It would require some code changes for sure. Some pointers: - The place in...

Try something like ``` mjcf.get_attachment_frame(self._walker.mjcf_model).pos = (spawn_x, spawn_y) ``` inside `if target.activated ...` clause, where `self._pick_new_target()` is called.

It seems something to do with pyopengl. What is your OS? I have found a similar issue on Ubuntu mentioned here https://github.com/mcfletch/pyopengl/issues/90, see if the fix suggested in the comment...

I've come up with the following workaround solution based on [this example](https://stackoverflow.com/questions/43915626/how-to-override-methods-on-bokeh-how-to-check-if-all-the-elements-are-already-r). It detects the disconnect and shows a popup to reload page. Use the [directory format](https://docs.bokeh.org/en/latest/docs/user_guide/server.html#directory-format), create custom `templates/index.html`...