OpenOversight icon indicating copy to clipboard operation
OpenOversight copied to clipboard

Remove duplicate profiles

Open McEileen opened this issue 6 years ago • 4 comments

These two profiles appear to be duplicates. (They have the same name and same first employment date.) seanaranasduplicate

Beside removing this specific duplicate, I wonder if there's any way to remove duplicates from the entire project? It seems like it would require a mix of automation and human work.

We could write a query to identify profiles that have the same department, first and last name, and first employment date? Then a project member could manually check that they are actual duplicates before removing unnecessary profiles. This would also require a step where information from the two profiles are combined. Thoughts on this approach?

McEileen avatar Dec 10 '18 22:12 McEileen

Yep, pretty much catch suspected duplicates and then let humans make sure that they are indeed duplicates. If I can gain admin permissions for this department, I'd also delete this duplicate.

ghost avatar Dec 30 '18 02:12 ghost

Hey @sibrahi5 to clarify am I assigned here just to delete the duplicate, or is the ask to work on automation?

ssempervirens avatar Feb 16 '19 16:02 ssempervirens

Hey @McEileen do you still think writing this query makes sense? If no details have changed since this previous convo, I can take this on

ssempervirens avatar Jul 31 '19 19:07 ssempervirens

@ssempervirens Yes, we still need someone to work on this, thanks for checking in about it. I think the previously outlined plan, where you write a query to catch suspected duplicates, then manually confirm they're duplicates before deleting them, makes sense.

McEileen avatar Jul 31 '19 20:07 McEileen