Enhancement Request: True user experience for AI bot

[Migdalin]

In the Atari environment, the agent receives the raw pixels from the screen and responds with joystick actions. Please provide an API like that for Starcraft 2.

So the API would provide the full screen (including minimap, unit actions panel, etc.) just the same as the user would see it. And it would support actions like: Keyboard( "A"), Mouse.MoveTo(x,y), Mouse.LeftClick(), Mouse.Drag(destX, destY).

[kuzi117]

It's completely headless on linux. Windows only I guess?

[Migdalin]

Not sure what is meant by headless. Are you saying there's a way to talk directly to the raw protocol (Protobuf, I think it's called)?

[alkurbatov]

Headless means without graphics.

[Migdalin]

They started off without what they call "rgb," per the original paper, but it has been added. Surely the rgb parts are available on linux as well, in the latest release?