ml-agents-dodgeball-env icon indicating copy to clipboard operation
ml-agents-dodgeball-env copied to clipboard

I feel like something wrong with agent's observations

Open c0mb1ne opened this issue 2 years ago • 0 comments

I was inspecting what kind of observations agents gets, and found that in this line of code, we trying to normalize the number remaining enemies to add them to observation. And this variable never being used in this code anymore. https://github.com/Unity-Technologies/ml-agents-dodgeball-env/blob/b2915bd442f88bef391d8c380227f5be65bfae60/Assets/Dodgeball/Scripts/DodgeBallAgent.cs#L305

but here we just add the flat number of remaining enemies, which is kinda goes against ml-agents guidelines about normalizing observation for better perfomance. https://github.com/Unity-Technologies/ml-agents-dodgeball-env/blob/b2915bd442f88bef391d8c380227f5be65bfae60/Assets/Dodgeball/Scripts/DodgeBallAgent.cs#L314

c0mb1ne avatar Apr 09 '23 14:04 c0mb1ne