pystk icon indicating copy to clipboard operation
pystk copied to clipboard

Openai gym support?

Open xkianteb opened this issue 5 years ago • 6 comments

This mainly a question. How difficult would it be to wrap this framework in a openai gym environment, so I could train a reinforcement learning agent to play this game ?

Does the framework support access to the Ai bot? Meaning can let the ai bot drive and record states and actions it visited and took?

xkianteb avatar Feb 21 '20 18:02 xkianteb

@xkianteb I recently was interested in training a bot playing the hockey game so I rolled out my own environment extending gym.Env. I think it was pretty straightforward for me to follow the code in examples/hockey_gamestate.py for my use case. I won't be able to share my specific implementation since it is used for a class project.

I encountered a few design decisions which I think can only be best handled if you write your own environment. For example,

  • What should I consider as an environment? For example, in the hockey game, you can play up to 2 vs 2. Should I train a team (2 players) at a time or maybe both teams?
  • What should be the state space? Real-world physical quantities or maybe a couple of frames of camera images?

Disclaimer: I'm not a developer of this project and have only used this game for classwork. Please only consider the above as an (inexperienced) user's comment.

Haoen-Cui avatar May 20 '20 08:05 Haoen-Cui

@Haoen-Cui were you able to run hockey_gamestate.py successfully? i'm getting an error as mentioned in #33

notjedi avatar Sep 26 '21 07:09 notjedi

@xkianteb did you do it? cause i'm trying to do the same here.

notjedi avatar Sep 26 '21 07:09 notjedi

@jedi2610 No I didn't but if you want to collaborate and make it happen I would be up for it.

xkianteb avatar Sep 26 '21 09:09 xkianteb

@jedi2610 No I didn't but if you want to collaborate and make it happen I would be up for it.

@xkianteb that's really cool. i'm down too. how can i contact you tho?

notjedi avatar Sep 26 '21 09:09 notjedi

My email address is: [email protected]

xkianteb avatar Sep 30 '21 16:09 xkianteb