EvalAI icon indicating copy to clipboard operation
EvalAI copied to clipboard

Add feature to disable private submission

Open Harshit28j opened this issue 1 year ago • 6 comments

image

Harshit28j avatar Aug 31 '24 17:08 Harshit28j

:warning: Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

Attention: Patch coverage is 15.38462% with 22 lines in your changes missing coverage. Please review.

Project coverage is 68.91%. Comparing base (96968d6) to head (9d8b8fc). Report is 1112 commits behind head on master.

Files with missing lines Patch % Lines
frontend/src/js/controllers/challengeCtrl.js 15.38% 22 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4419      +/-   ##
==========================================
- Coverage   72.93%   68.91%   -4.02%     
==========================================
  Files          83       20      -63     
  Lines        5368     3600    -1768     
==========================================
- Hits         3915     2481    -1434     
+ Misses       1453     1119     -334     
Files with missing lines Coverage Δ
frontend/src/js/controllers/challengeCtrl.js 60.57% <15.38%> (-13.13%) :arrow_down:

... and 63 files with indirect coverage changes

Files with missing lines Coverage Δ
frontend/src/js/controllers/challengeCtrl.js 60.57% <15.38%> (-13.13%) :arrow_down:

... and 63 files with indirect coverage changes


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 11ea23e...9d8b8fc. Read the comment docs.

codecov-commenter avatar Aug 31 '24 18:08 codecov-commenter

image image

Harshit28j avatar Sep 01 '24 05:09 Harshit28j

@gchhablani I have also tested this by hosting a challenge from EvalAI-Starters using challenge_config.yaml, adding the disable_private_submission attribute to a challenge, and also tested by upgrading its value.

Harshit28j avatar Sep 01 '24 05:09 Harshit28j

@Harshit28j Can you share screenshot of the my submissions page too?

gchhablani avatar Sep 01 '24 10:09 gchhablani

@gchhablani here:

  1. When the value of disable_private_submission = true image

  2. When the value of disable_private_submission = false image

Harshit28j avatar Sep 01 '24 13:09 Harshit28j

Hello all,

We’re hosting a challenge at the end of this month, and this feature would make a big difference. In past editions, everyone kept their submissions private, which left the leaderboard outdated and discouraged competition.

Disabling private submissions will keep the leaderboard active and make the event more engaging. Could you help speed up the review of this pull request? It’s exactly what we need for this challenge!

Thanks a lot!

SSHurtado avatar Oct 07 '24 08:10 SSHurtado