ajl.ai icon indicating copy to clipboard operation
ajl.ai copied to clipboard

Create baseline visualization on home page

Open boazsender opened this issue 7 years ago • 4 comments

  • visualize annotation stats from annotation campaign
  • visualize ethnic/gender/age of landmark-annotated faces

Primary goal: motivate citizens to participate.

Show users how their participation improves their participation

boazsender avatar Mar 01 '17 21:03 boazsender

From @tafsiri: show a head to head of this systems labels against the NIST standard.

boazsender avatar Mar 01 '17 21:03 boazsender

from @tafsiri: build it up in three stages?

  1. What is the existing data

  2. What are the actions that are done to faces based on these data

  • detection
  • classification
  • recognition
  1. What impact can you, and have you had by being a part of this annotator community.

boazsender avatar Mar 01 '17 21:03 boazsender

A different idea from @vlandham:

enter your demographics and see how you are represented in a set of histograms of datasets by demographics.

Example:

  • Base visualization shows distribution across a metric (such as age).
  • Could show multiple datasets at one time.

Then additional UI something like flowing datas to enter in personal data, such as:

  • I'm a 34 white male.

those faces matching this description light up in the distribution. Additional meta data about how much of the dataset vs average across all datasets is presented.

boazsender avatar Mar 01 '17 21:03 boazsender

Btw another thing that occurred to me on the way home (which is probably obvious to you). Is that i've been thinking about the dataset like its a training dataset when its actually a (held out) test dataset (is that correct)? Which could allow for another framing as well around "how even in measuring the accuracy of a given tool its only taking X number of people from this demographic into account", which is maybe what you were going for and i just understood.

tafsiri avatar Mar 02 '17 16:03 tafsiri