CS294 2018 Fall

Here is my pip3 env:

atari-py==0.1.7
box2d-py==2.3.8
gym-minigrid==0.0.3
gym==0.12.1
Keras-Applications==1.0.7
Keras-Preprocessing==1.0.9
matplotlib==3.0.3
mujoco-py==2.0.2.2
numpy==1.16.4
opencv-python==4.1.0.25
pandas==0.24.2
scipy==1.3.0
seaborn==0.9.0
tensorboard==1.12.2
tensorflow-estimator==1.13.0
tensorflow-gpu==1.13.1
torch==1.1.0
torchvision==0.2.2.post3
tornado==5.1.1
tqdm==4.32.1