sturdyplum

I think there is a simpler way to do this (without having to edit dopamine source code). You could simply wrap your environment with https://github.com/google/dopamine/blob/76cdae1f858233a8501e2b61095cde54c6f8a214/dopamine/discrete_domains/gym_lib.py#L306 Then you can put the...

From what I've seen it should be pretty much possible to add any environment with a discrete action space. If you want to add a custom environment is actually really...