pyboreas icon indicating copy to clipboard operation
pyboreas copied to clipboard

Limit how often people can submit to the benchmark

Open keenan-burnett opened this issue 1 year ago • 0 comments

We want to make it hard for people to overfit to the test set. One way to do this is to limit how many submissions each user can make per month, say 2 submissions per month. We may need an auxilliary authentication method to prevent users from creating multiple accounts to circumvent this.

keenan-burnett avatar Jun 08 '23 16:06 keenan-burnett