PufferLib icon indicating copy to clipboard operation
PufferLib copied to clipboard

Fixed Spaces so it now converges

Open xinpw8 opened this issue 1 year ago • 0 comments

Fixed Spaces env: dtype=np.int8 -> dtype=np.float32, which was causing model to fail to learn. Reset dtype updated for consistency.

xinpw8 avatar Aug 10 '24 05:08 xinpw8