SOCVFinder icon indicating copy to clipboard operation
SOCVFinder copied to clipboard

Hydrant - A Dashboard for Heat Detector

Open Bhargav-Rao opened this issue 7 years ago • 5 comments

HydrantLogo

Hydrant - A dashboard for Heat Detector

After collecting some important points about the new dashboard, I'm compiling them here and formalizing the creation of a new dashboard.

Need

Heat Detector is quite famous networkwide for its ability to detect rude and abusive comments. However the problem that we are facing at hand is that not many people are feeding back accurately (The bot utilizes ML and feedback is very very important for it's improvement). This issue can be easily solved by having a web dashboard.

Thoughts

Unlike CopyPastor, which had to be written from scratch, the dashboard for HD can be easily modeled based on Sentinel. The similarities between Natty and HD are:

  • Both are related to flagging (comment vs answer)
  • Both have various reasons for detections
  • Both need feedback

Changes

Changes needed on the HeatDetector side:

  • A proper/strict rule to differentiate between what should be a true positive and what should be a false positive.
  • A way to provide feedback through a command, so that a userscript could be made use of.
  • And of course, calling the dashboard in every report.

Challenges

  • Framing the strong rules to differentiate between a heated argument and not is often subjective. Quantizing this in someway in order to improve the algorithm would be the first challenge. (This is not related to the dashboard development work, but the way we provide feedback).
  • Few of the posts might be borderline, and we wouldn't want to feedback these. Hence a way to "not provide feedback" would be needed.
  • We are also tracking a few keywords like "spam", "rude", etc which aren't noisy comments, but are meant to help us discover spam or r/a posts. We need a different feedback type for this.
  • We need to find a way to anonymize the data which we display on the dashboard. Some kind of a login would be nice, but one other idea is to display minimal information (just the comment text and reasons, for example), and display all the details after logging in.
  • Art is very very busy at the moment and certainly won't have much time to design the dash. Hence we'll need to either do it in one of the languages which we know or recruit someone who knows Ruby and RoR. Given that we still haven't put up an opensource ad this time, it might be a bit hard.

Hosting

We can host it on the sobotics webserver. That would not be an issue.

Bhargav-Rao avatar Feb 03 '18 22:02 Bhargav-Rao