EvalAI
EvalAI copied to clipboard
Add categories to challenges
Description
This PR is similar to #3891.
Currently it is difficult to find challenges by categories (Workshop Challenge, Dataset Challenge, Challenge related to a Paper, New Environment Challenge), etc. The idea is to understand the reason behind the challenge being hosted (whether to test a benchmark a new dataset or test a new environment, for example). This issue is a first step towards that direction where we add the category a particular challenge belongs to and display it on the challenge page in this section:

The challenge domain must be made a part of the challenge configuration and the EvalAI-Starters repository.
This will also require you to add changes to the challenge validation script to ensure people put appropriate values for categories. Please create a PR with these dummies - [Paper, Dataset, Environment, Workshop]
, before to converge to the set of domains we might want to include.
A next step for this one will be to allow users to edit the domain on the challenge page and provide a drop-down of things to select from.
Pre-requisites/Learnings
This issue essentially requires background on a few things:
- An understanding of the challenge configuration.
- A high-level understanding of EvalAI challenges.
- An understanding of our frontend.
- How the challenge validation works.
How to Approach
- You can start by setting up EvalAI locally. Set up the dev version locally (preferred) using the steps here.
- Add a new field to the challenge model in Django.
- Play around with the challenge configuration and the frontend, put up screenshots on your PR.
- Update the challenge validation script to check for the newly added field.
- Reach out to us regarding any issues that you face or if you need any help with understanding any of the above.
@gchhablani I would like to take this issue
Hi @gchhablani I would like to pick this issue. Can you please assign it to me?
@Suryansh5545 I am assigning this issue to you. Please take it up. Let us know if you face any issues. @b9aurav Can you please take up #3893?