async_deep_reinforce icon indicating copy to clipboard operation
async_deep_reinforce copied to clipboard

Large action space

Open gowthamnatarajan opened this issue 9 years ago • 2 comments

Is this implementation suitable for Large action spaces? Like 1000s of possible actions? Also, can this be modified to make it work with the problem I am trying to solve? I would like to use this implementation for modify the state and action spaces.

gowthamnatarajan avatar Jul 03 '16 00:07 gowthamnatarajan

@gowthamnatarajan Sorry I'm not sure this implementation can be used for large action space. (I tried to start toy program to check with 1000 actions, but couldn't check well.)

I'm now testing OpenAI gym environment in "gym" branch, so if you want to try another problem, please change game_state.py and ACTION_SIZE in constants.py in gym branch.

miyosuda avatar Jul 05 '16 15:07 miyosuda

I have about 1500 actions. Will checkout your other implementation. Google has a paper for handling large action space https://arxiv.org/pdf/1512.07679.pdf

gowthamnatarajan avatar Jul 06 '16 11:07 gowthamnatarajan