Alexander Nikulin
Alexander Nikulin
There's another problem at the moment. The agent can see through walls 🥲! Unfortunately, the naive porting of the FOV algorithm from MiniGrid slows things down too much (although it...
> Maybe I'm being naive here and missing a key detail of why this wouldn't work. There are actually two reasons why I didn't already done this: the first is...
Hi @alexunderch! Personally, I am totally new to the gradient-based side of meta-RL and will definitely do first iteration based on some reference implementation to properly understand how it all...
@EdanToledo understandable! Unfortunately I have not found any other implementation on jax + ppo. Do you have any references you used when you were figuring it out (besides the original...
@jurgisp also, I think with the release of https://github.com/Farama-Foundation/Shimmy (specific wrapper for dm_env [here](https://github.com/Farama-Foundation/Shimmy/blob/f1dfc55f02722e0ddbf99c6c3a7d028240dc3f8e/shimmy/dm_control_compatibility.py#L34)) you can deprecate or remove gym wrappers (well, they are already for the outdated gym interface)....
@jurgisp can I make a PR with gym updated to gymnasium and GymWrapper swapped to the wrapper from shimmy?
Hi @yuecao0119! I also need to get hidden states from v3 models. How should I modify the config? Can I do it without forking the official hf repo? Thanks! P.S....