Allow "gym.spaces.Box" action space in custom environments

[joe-waddell]

Per documentation on the SIMPLE blog post, the current implementation of SIMPLE only allows "Discrete" action spaces in custom environments. It would be useful to be able to use "Box" action spaces as well.

When attempting to use a "Box" action space such as this: self.action_space = gym.spaces.Box(low=0, high=1, shape=(10, 10), dtype=np.int)

The following output is generated: Value passed to parameter 'indices' as DataType float32 not in list of allowed values: uint8, int32, int64

Please let me know how I can help.