robot-learning
robot-learning copied to clipboard
SAC training
Hello, I was running SAC and noticed that the performance was excellent until around 500,000 steps. After reaching this point, there seemed to be a noticeable downturn. Could you help me understand what might be causing this? If you could answer my question, I would be very grateful.