Sasha Abramowitz
Sasha Abramowitz
Solution we found in #940 was `from typing_extensions import NamedTuple`. Solves the immediate issue, although upgrading to 3.11 would still be nice, just not as urgent
I have tested python 3.12 and it seems to work without issue, we should drop support for 3.9 (and possibly 3.10 also) soon as it is nearing end of life.
Bug was fixed in #1076
Right now no as all the environments we currently use there is no truncation and so there's no issue. However, it is high on the list, but unfortunately the whole...
Yup, both IQL and SAC handle it correctly. It's only the PPO systems that have the issue. All that needs to happen in ppo is that discounts need to be...
After some experimentation this helps in certain envs but hurts others and needs quite a lot more investigation, unfortunately I don't have the time right now. The current progress is...
9676a5b72bd51a556de111a77bdddd04f783a45e
Hey @ashok-arora I implemented this a while ago, but I'm not aware of any previous environment that this is based on. It was just meant to be a very simple...
Thanks for pointing these out, we can update the functionality :smile:
1. Yes it's likely the underlying XLA that JAX is compiled to 2. Less delays, but still could likely be better 3. One possible improvement is that we could inform...