Yuri

Add envs from ROBEL (currently only MuJoCo)

1

[ROBEL: Robotics Benchmarks for Learning](https://github.com/google-research/robel) On their [website](http://roboticsbenchmarks.org), they say that _"Support for Bullet is planned."_ So it might be a good candidate for adding to pybullet-gym in the future.

HumanoidBulletEnv-v0 crashing in multiple RL frameworks

5

Hello. I have been trying to train an agent in `HumanoidBulletEnv-v0`. I have tried using multiple frameworks and algorithms, but have not been able to obtain a good policy in...

In [`anyrl/models/feedforward_ac.py`](../blob/531dd920e77f1b77d63d52bd56aad0807bfdccd8/anyrl/models/feedforward_ac.py#L56), the function `step` may assign zero-values in `feed_dict`. This may cause [`self.session.run((self.actor_out, self.critic_out), feed_dict)`](../blob/531dd920e77f1b77d63d52bd56aad0807bfdccd8/anyrl/models/feedforward_ac.py#L58) to return `act` and `val` as arrays containing `nan`'s that may eventually throw an...