`leaderboard_decimal_precision` and `is_leaderboard_order_descending` cannot be set from `challenge_config.yaml`

[felixp8]

I've been testing a challenge on an local EvalAI clone but have been unable to properly set leaderboard_decimal_precision and is_leaderboard_order_descending from my challenge_config.yaml.

Expected behaviour Altering leaderboard_decimal_precision and is_leaderboard_order_descending should be reflected in the leaderboards on EvalAI.

Observed behaviour Regardless of the values of those fields, all leaderboards have a decimal precision of 2 and are sorted in descending order. Manually setting these fields from the Django admin page does result in the expected leaderboard layout, though.

Steps to reproduce the problem Clone EvalAI-Starters, edit those two fields in challenge_phase_splits in challenge_config.yaml, run ./run.sh, upload to a local EvalAI clone, make dummy submissions, and view the leaderboard.

Is this an issue with EvalAI or could there be something wrong on my end?

[RishabhJain2018]

Hi @felixp8,

Thanks for reaching out. This doesn't use to happen with EvalAI earlier, but we can check and get back to you. cc: @Ram81

[seokhwankim]

I have exactly the same problem. Is there any update to solve this issue?

[rcannood]

Hello all! I have the same problem for this leaderboard and this one. I set my precision to 4 via the config, but the leaderboard is still 2.

[Ram81]

Hi @felixp8 @seokhwankim @rcannood,

Thanks for pointing out the issue. We are working on fixing it. We will update on this thread once we have released a fix.

[seokhwankim]

Hi @Ram81 Is there any update on this bug fix?