EvalAI icon indicating copy to clipboard operation
EvalAI copied to clipboard

Send email to challenge hosts only when the worker reload is complete and successful

Open RishabhJain2018 opened this issue 4 years ago • 1 comments

Current Scenario: Whenever a challenge hosts updates an evaluation script or the test annotation file then the email for reloading is sent to them immediately after the upload of annotations file or the evaluation script file which gives a wrong sense to challenge hosts that the worker is reloaded but actually it is not because it takes 2 mins on AWS to reload it successfully.

Fix:

  1. Send the email to challenge hosts immediately after upload saying that worker reload is started and it will take 2 mins to complete and they will be notified again when it is successfully reloaded.
  2. Send another email to challenge hosts when the worker reload is successful on AWS.

RishabhJain2018 avatar Jul 07 '20 03:07 RishabhJain2018

Hey, Is the issue still open?

3V3RYONE avatar Nov 28 '21 16:11 3V3RYONE