Intransparent Leaderboard points

[HUisHU-Christian]

So far it is quite unclear, why some persons get more points for less suggestions, answers or labels. This seems unfair. It would be nice to see a legend or a link to the legend to see how the points are calculated.

[andreaskoepf]

The magic formula can be found here:

    def compute_leader_score(self) -> int:
        return (
            self.prompts
            + self.replies_assistant * 4
            + self.replies_prompter
            + self.labels_simple
            + self.labels_full * 2
            + self.rankings_total
            + self.rankings_good
            + self.accepted_prompts
            + self.accepted_replies_assistant * 4
            + self.accepted_replies_prompter
            + self.reply_ranked_1 * 9
            + self.reply_ranked_2 * 3
            + self.reply_ranked_3
        )

The web team decided for simplicity not to show all columns/values. Future version might also include values which are currently only calculated for the troll-boards (i.e. scoring will be based on even more values). Maybe link to the score-function can be added to the FAQ or documentation.

[fozziethebeat]

This is a good invitation for someone to figure out how to display all those de-aggregated statistics in a way that resolves this issue

[AbdBarho]

Refs #996 https://github.com/LAION-AI/Open-Assistant/issues/1957