logs_rubi_val_oe.json not getting generated

[abhipsabasu]

When I run rubi, the following files are getting generated. No logs_rubi_val_oe.json is getting generated. Is it the rubi accuracy that is present in logs_val_oe.json? The numbers seem to be tallying with that of rubi as reported in the paper. Attaching the screenshot below.

[cdancette]

Can you check the _rubi_val_oe.json as well ? It seems more likely that logs are there, I'm not sure why it's missing the log prefix

[abhipsabasu]

On checking _rubi_val_oe.json, I saw the overall accuracy is max 37.22, whereas in logs_val_oe.json, the max accuracy is 48.01. So the latter score is matching with that of the paper isnt it?

[cdancette]

Yes you are correct In _rubi_val_oe there are the scores obtained by keeping the question only branch.

Le jeu. 25 nov. 2021, 05:05, abhipsabasu @.***> a écrit :

On checking _rubi_val_oe.json, I saw the overall accuracy is max 37.22, whereas in logs_val_oe.json, the max accuracy is 48.01. So the latter score is matching with that of the paper isnt it?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/cdancette/rubi.bootstrap.pytorch/issues/15#issuecomment-978811067, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACQPYN5PZT6IEHRCVMBRZETUNWYXPANCNFSM5IV4GBOA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

[abhipsabasu]

Okay thanks a lot

[abhipsabasu]

Hi, In the paper, did you report the highest validation accuracy? or the validation accuracy obtained at the end of training?