Browsergym hangs for hours when trying to save summary info for last run

[xhluca]

When running on the test split (381/381, i think task id 811 but not sure), it hangs at the following stages:

2024-12-17 02:32:41,293 - 345050 - browsergym.experiments.loop - INFO - Saving summary info.

It stays like this for hours.

[TLSDC]

Hi @xhluca, I'm missing some information, what benchmark are you running on here ? Is it consistently happening ? Would you have a reproducible piece of code for this issue ? Thank you

[xhluca]

I'm running on webarena test on lightly modified version of the main script. I don't have error trace so it's hard to to give more detail. Reproducing is hard... Since it doesn't have consistently and it takes a long time to run.

I will give more details when it happens again

[MurtyShikhar]

Just commenting to say that I am also seeing these issues where exp_args.run() sometimes hangs after executing an action, or when saving summary. This happens on both webarena, and for open-ended exploration of live websites. Currently i'm just wrapping things in a timeout block.