ReinforcementLearning.jl icon indicating copy to clipboard operation
ReinforcementLearning.jl copied to clipboard

MultiThreadEnv not available in ReinforcementLearningZoo

Open thomashopkins32 opened this issue 3 years ago • 1 comments

The definition for MultiThreadEnv exists under src/algorithms/policy_gradient/multi_thread_env.jl but that file is not included in policy_gradient.jl , algorithms.jl, or ReinforcementLearningZoo.jl. Is this intentional?

After trying to include it in policy_gradient.jl, I ran into some dependency issues with MacroTools and EnrichedAction not being defined. I think I solved MacroTools by adding using MacroTools and adding it to ReinforcementLearningZoo/Project.toml.

EnrichedAction appears to be defined in the archived ReinforcementLearningZoo.jl repository (here). Should this also be defined in the ReinforcementLearningZoo package in this repo?

thomashopkins32 avatar Jul 26 '22 01:07 thomashopkins32

Is this intentional?

yes, policy gradient related algorithms are not ready yet in the master branch.

You may read the source code at https://github.com/JuliaReinforcementLearning/ReinforcementLearning.jl/tree/v0.10.1 for the stable version.

findmyway avatar Jul 26 '22 07:07 findmyway