Tim Bauman

## Problem Today only synthetic preferences are supported. It would be great to support real human preferences. ## Solution Requirements: - record videos of trajectories - ideally, extensible so we...

Add support for a simple preference UI

3

## Description See #711 ## Testing TODO: add notebook and experiment config that use this feature, and screenshots of behavior. (I've tested myself but not in a clean way.)

See https://github.com/HumanCompatibleAI/imitation/pull/657 - replace hardcoded paper results with a CSV of results that we can compare and update Also, include instructions for updating the CSV, and a comparison between paper...