[Merged] Issues with EDIT menu

[Didayolo]

1. Edit menu not as powerful as competition.yaml file

The leaderboard, as well as other things, cannot be edited efficiently with the web interface. Especially, it's impossible to edit the leaderboard columns after the upload of the bundle (and possibly the start of a competition). This is not absolutely unconvenient. It is still possible to edit the scoring program, so changing the logic behind the scoring is always possible. However, the label of the score (the name) won't change on the leaderboard.

• [ ] In many cases, we need to re-create the competition (re-upload the bundle) with another competition.yaml file to solve the issue.

Examples:

• #2390

• #2613

• #2755

• #3017

• #3333

• #3265

• Also, phases added after the competition creation are not working well: #2186, #2971

2. Changes not saved

• [ ] Sometimes the changes won't be reflected after submit the EDIT (competition) form.

• #2665
• #2458
• #1739

When there is an error somewhere, it prevents the EDIT to take place. In this case, the user is getting back to the editor instead of being redirected to the homepage of the competition. By scrolling down, we can usually find a red error message indicating the problem.

We need then:

• More informative error messages,
• More visible error messages (e.g. a red bar in top of the webpage).

• [ ] More specifically, some people can't add new admins (with short names in most cases):

• #2632
• #2639
• #2653
• #2781
• Adding admins to competitions should be done with email address, not username. Also, it should not give the email information.

[sashaspala]

Hi,

Not being able to update leaderboard labels from the editor is a major issue for us as competition organizers, especially because the option to edit the leaderboard is available in the edit menu, even though in many cases it does not work. Is this in the roadmap for any upcoming releases? Do you have an idea for when it will be fixed? I am hesitant to re-create a new competition but I would rather cut our losses now if there are no solid plans in place yet to fix the edit menu issues.

Thanks!

[Franck-Dernoncourt]

Also I don't think it's a good idea to merge multiple issues into one single issue, because it makes it impossible to efficiently track a specific issue.

[Didayolo]

@Tthomas63 @ckcollab : Do you have any insights about this?

[Didayolo]

@sashaspala After discussion with Codalab's main engineers, this is the next issue they are going to tackle (priority 1).

[sashaspala]

Awesome, thank you! Any chance we can get a ballpark estimate of how long it will take? Our evaluation period will begin in January and I would love for us to have at least 6 weeks of public leaderboard results to show. Again, thanks for taking the time to prioritize this.

[sashaspala]

@Didayolo - any update on this? We need to have the leaderboard functioning by the end of January so it would be helpful for us to know if the fixes will be ready by then.

[Didayolo]

@ckcollab any update on this?

[Didayolo]

Dear all,

It seems that this will be fixed during February.

Sorry for the inconvenience.

[zhou13]

Has this been fixed?

[Didayolo]

9 November 2021 note: the bug preventing to rename keys from the editor has not been solved. It is an important issue to fix.

[Veranchos]

Hello! I also faced the problem of not being able to update the leaderboard. Are there any news on this issue? If there is only possibility to re-upload the bundle, how I can do it? I can't find information about making changes in competition bundle. Or this means that I need to create the new competition with updated competition bundle?

[Didayolo]

Or this means that I need to create the new competition with updated competition bundle?

Exactly.