[Question] Profiling with custum environment and MPI

[AlessandroZavoli]

I would like to better understand what are the bottleneck in my code ( PPO[mpi] with MLP and custom environment) Could someone point me to a good reference to understand how to profile the code?

Alessandro

[Miffyli]

I do not have tips for proper profiling (I do things caveman-style with printing), but you could try using PPO2 (non-mpi) variant of PPO to avoid hassling with MPI. PPO2 code has gone through more updates as well. For baseline results try running the code with a simple env (e.g. Cartpole-v1), after which you can study your custom env what is slowing things down.