EvalAI icon indicating copy to clipboard operation
EvalAI copied to clipboard

Add categories to challenges

Open gchhablani opened this issue 1 year ago • 3 comments

Description

This PR is similar to #3891.

Currently it is difficult to find challenges by categories (Workshop Challenge, Dataset Challenge, Challenge related to a Paper, New Environment Challenge), etc. The idea is to understand the reason behind the challenge being hosted (whether to test a benchmark a new dataset or test a new environment, for example). This issue is a first step towards that direction where we add the category a particular challenge belongs to and display it on the challenge page in this section:

Screenshot 2023-03-20 at 12 51 31 PM

The challenge domain must be made a part of the challenge configuration and the EvalAI-Starters repository.

This will also require you to add changes to the challenge validation script to ensure people put appropriate values for categories. Please create a PR with these dummies - [Paper, Dataset, Environment, Workshop], before to converge to the set of domains we might want to include.

A next step for this one will be to allow users to edit the domain on the challenge page and provide a drop-down of things to select from.

Pre-requisites/Learnings

This issue essentially requires background on a few things:

How to Approach

  • You can start by setting up EvalAI locally. Set up the dev version locally (preferred) using the steps here.
  • Add a new field to the challenge model in Django.
  • Play around with the challenge configuration and the frontend, put up screenshots on your PR.
  • Update the challenge validation script to check for the newly added field.
  • Reach out to us regarding any issues that you face or if you need any help with understanding any of the above.

gchhablani avatar Mar 20 '23 17:03 gchhablani

@gchhablani I would like to take this issue

Suryansh5545 avatar Mar 20 '23 17:03 Suryansh5545

Hi @gchhablani I would like to pick this issue. Can you please assign it to me?

b9aurav avatar Mar 21 '23 05:03 b9aurav

@Suryansh5545 I am assigning this issue to you. Please take it up. Let us know if you face any issues. @b9aurav Can you please take up #3893?

gchhablani avatar Mar 21 '23 06:03 gchhablani