iSAID_Devkit icon indicating copy to clipboard operation
iSAID_Devkit copied to clipboard

Published 20 hours ago • verified publisher icon CAPTAIN-WHU

Evaluation server, big files and manual submission

Open kgiannakelos opened this issue 3 years ago • 11 comments

Hello,

i uploaded an 88mb zip to the evaluation server but it seems that the server went down and didn't respond after a day.

The uploading speed also seems very slow. Is there any other way for uploading our results?

Maybe i can send you manually the file via email or dropbox and make the evaluation yourselves? It is important to get some immediate results.

Thanks you.

-- UPDATE --

I uploaded a very small subset of my results and the evaluation server responded, so the format is correct.

It seems that i definitely need to do a manual submission of my results since the evaluation server times out. Could you please help me with that?

kgiannakelos avatar Apr 22 '21 06:04 kgiannakelos

Hello @kgiannakelos, the evaluation server is maintained by @dingjiansw101 he will be able to help you solve the issues regarding the server.

akshitac8 avatar Apr 27 '21 07:04 akshitac8

@akshitac8 Thanks for your response. I already contacted @dingjiansw101 but the issue is not resolved. I need to do a manual submission because the server times out and cannot complete the full evaluation.

Shall i send you the file and have you delegate the request to the evaluation server?

According to this, it is possible to send you the results on [email protected] (i assume it's you @akshitac8) right?

kgiannakelos avatar Apr 29 '21 07:04 kgiannakelos

@akshitac8 Any updates on this? Can i send you my results as stated here?

kgiannakelos avatar May 07 '21 11:05 kgiannakelos

@kgiannakelos Can you try to upload the results on the sever now?

akshitac8 avatar May 09 '21 10:05 akshitac8

@akshitac8 The upload page does not load at the moment.

kgiannakelos avatar May 09 '21 11:05 kgiannakelos

@akshitac8 Tried again, still no response.

If i use a subset of my results (results with at least 15% confidence instead of 5%), it works but then do not get a proper mAP calculation. So i guess the size of my file is the problem.

Can you try evaluating my file to your server? Only once would suffice.

Thank you.

kgiannakelos avatar May 11 '21 07:05 kgiannakelos

@kgiannakelos Can you try to upload the results on the sever now?

I also have the same question. Can I send you the result and you help me evaluate the result in local enviroment? Only once would suffice. Thank you!

czq693497091 avatar May 13 '21 15:05 czq693497091

@czq693497091 @kgiannakelos It takes roughly about 1 hour for uploading the results on the server and during that time it doesn't show anything. So, please don't refresh the browser before that time.

akshitac8 avatar May 24 '21 07:05 akshitac8

@akshitac8 Yes i know and that's why I do not refresh the page, i just leave it as it is and still get timeout after 3-5 hours.

Is it maybe hanging due to some other reason? Perhaps multiple concurrent requests?.

kgiannakelos avatar May 24 '21 07:05 kgiannakelos

@kgiannakelos I uploaded the results from my end and it works for me. I got the results after 1.5 hours. if the issue still persists, then @dingjiansw101 is the right person to contact as he handles the server.

akshitac8 avatar May 24 '21 08:05 akshitac8

@akshitac8 What results did you upload? If you uploaded your own results then obviously they are not comparable to my results.

I already contacted @dingjiansw101 but i didn't get any help.

So to my understanding, a manual submission is not possible?

kgiannakelos avatar May 24 '21 08:05 kgiannakelos