envpool icon indicating copy to clipboard operation
envpool copied to clipboard

Published 20 hours ago • verified publisher icon sail-sg

Procgen Integration Draft

Open YukunJ opened this issue 2 years ago • 0 comments

Description

Continued Procgen integration progress with @LeoGuo98 together.

A few things:

  1. globalGameRegistry somehow doesn't successfully register each game while bazel build & compile. Temporary solution is just write a patch for each game to return a shared_ptr<Game> in this commit.

  2. (Unsolved Problem) The batch size for the StateBufferQueue seems to be 0, even if we set it explicitly, which leads to division by zero error. We haven't figured out what's the cause behind it. The env._recv() and env._reset() is the "crash entry point". See details comments in this commit.

We will continue look into this. Meanwhile, it would be of great help if @Trinkle23897 could help take a look and shed some hints on what we might have done wrong.

YukunJ avatar Sep 16 '22 02:09 YukunJ