Confusion over which is the best model in the exploring the limits of behavioural cloning

[anthonyfong100]

Reading the readme section (https://github.com/felipecode/coiltraine/blob/master/docs/exploring_limitations.md), it is stated resnet34_imnet10S1 corresponds to seed 2 in the paper and is the best model. However, under one of the sample commands to test the best model under the hardest condition,

python3 coiltraine.py --gpus 0 --single-process drive -e resnet34imnet10S2 --folder nocrash \
-de NocrashNewWeatherTown_Town02 --docker carlagear

It seems to suggest that the best model is infact resnet34iment10S2. I believe that this is an error and it should instead be resnet34imnet10S1. Is this really the case? Please advice, Thanks!

[Flora279]

Hi, I also have a question regarding to the yaml file provided.

Why we have AVOID_STOPPING: FALSE for all models no matter for nospeed or with speed branch.

I would expect it to be TRUE for speed models.

Anyone can help?