food-oasis icon indicating copy to clipboard operation
food-oasis copied to clipboard

Establish UX Benchmarking

Open ryu-jieun opened this issue 2 years ago • 10 comments

Overview

In order to measure the effectiveness and impact of UX research and to track the overall progress of Food Oasis sites, we would like to discuss what and how to measure them.

Action Items

  • [x] Write a short context paper on why we need UX benchmarking
  • [x] #1146
  • [ ] #1147

Related to (or might replace)

  • [ ] #1127

Resources/Instructions

Related issues

  • #1355

ryu-jieun avatar Jan 07 '22 22:01 ryu-jieun

@LIlinit @ryu-jieun

I have turned this issue into an epic, because it is too big for one issue. I have created two new blank issues and linked them. Please fill those issues out. All issues on the site, across all practice areas, need to be separated into food seeker and volunteer issues respectively so that they can be managed by their respective PMs

Also, the user story that is present in the overview above is not clear enough for people other than yourselves to understand how we will know when this issue is done or what exactly should go into it.

Please let Ben know when you have revised this issue and its sub issues.

ExperimentsInHonesty avatar Jan 11 '22 18:01 ExperimentsInHonesty

Some actions we can take that we discussed today and noting them here. Maybe move these to sub-tasks or to issue description at top?

  • [ ] Review what analytics packages we currently have (might review source code of site — I saw only Firebase Analytics (AKA Google Analytics)
  • [ ] Get everyone interested access to those analytics
  • [ ] Discuss among team what stats are useful for us
  • [ ] Identify gap between what we have currently and what we want
  • [ ] Implement what we can

fancyham avatar May 20 '22 07:05 fancyham

Website Analytics needs to be made a priority as we are moving towards adding Food Oasis on more websites. Making this a goal of the Impact Sprints and moving to Prioritized Backlog.

staceyrebekahscott avatar Aug 08 '22 22:08 staceyrebekahscott

@GigiUxR I see you reopened this issue after it was closed and put in the Done column. I moved it back to the Backlog column. Keep in mind that there is no automation to put the issue back in the correct priority, so if you reopen an issue, you must manually reprioritize it.

staceyrebekahscott avatar Sep 20 '22 03:09 staceyrebekahscott

@staceyrebekahscott to inquire about resources / guides specific to nonprofit UX Benchmarking Waiting for Tyler to get onboarded then assign this issue to him.

GigiUxR avatar Sep 23 '22 02:09 GigiUxR

I posted a message on the Code for America # general-discussion Slack channel, seeking advice/ guidance on benchmarking for public/ non profit.

staceyrebekahscott avatar Sep 23 '22 23:09 staceyrebekahscott

FYI, here is the conversation from the UX Benchmarking question I posted on the CfA Slack:

Stacey (she/her) [4:47 PM] Hello! Does anyone have any advice/ guidance regarding UX Benchmarking for websites in the Non Profit sector? I ask assuming there might be different criteria to consider for non profit/ public sector vs. commercial/ private sector.

Ray Kiddy [4:54 PM] UX Benchmarking would be similar to commercial efforts. The differing goals would drive differences in benchmarking. For example, commercial and non-profits would measure session length (# pages visited) but the NP would be oriented to helping a user goal and not driving users to the checkout. What is the audience. Differently-abled people might prefer more of a focus on site simplification and ADA compliance.

Stacey (she/her) [5:19 PM] So, there's not a difference in the process of benchmarking, it's that the measurements of success would be different based on goals.

Stacey (she/her) [5:21 PM] Our website is a food pantry locator, so the audience would cross many different demographics.

Chris Eberhardt [5:57 PM] Yes, I was going to say, it would be a good thing to be 508 compliant.

staceyrebekahscott avatar Sep 27 '22 01:09 staceyrebekahscott

@GigiUxR Moved to In Progress. Will leave to you to assign to the researchers once you go through the kanban board/ issue workflow training.

staceyrebekahscott avatar Sep 27 '22 03:09 staceyrebekahscott

FYI, on a related DEI (diversity equity inclusion) and Section 508 compliance note: I created an Accessibility benchmarking issue here for the food-seeker site:

  • #1355

fancyham avatar Sep 30 '22 03:09 fancyham

  1. Created "what is UX benchmarking" presentation and context paper.
  2. Created spreadsheet to help identify UX benchmark priorities and metric opportunities focused on: web analytics, volunteer user testing/survey, and food seeker testing/survey.
  3. Prioritized web analytics and volunteer benchmarking.
  4. Will meet with analytics team to establish metrics (ongoing)
  5. Will meet with research lead + current team to determine timeline and most relevant metrics before establishing research plan for volunteer benchmarking (ongoing) Context Paper.v2.docx.pdf UX_Benchmarking_Presentation_10_13_2022.pdf

ToledoPHD avatar Oct 28 '22 00:10 ToledoPHD