World-Cleanup-Day icon indicating copy to clipboard operation
World-Cleanup-Day copied to clipboard

Remove duplicate reports

Open lynxlynxlynx opened this issue 6 years ago • 1 comments

Until #73 and #33 get fixed, duplicate reports will continue to accumulate.

Some stats from yesterday's trashpoint dump:

  • 242 exact duplicates
  • 316 if you allow for 1m offset
  • 501 if you allow for 5m offset
  • 626 if you allow for 10m offset (offsets only checked against latitude, since degrees longitude aren't constant)

Too much to remove by hand and it's hard to identify them on the map anyway, so ideally this would be scripted via the API. Would also resolve some apparent clustering issues.

The filtered dump: trashpoints-dupes.zip You can adapt the threshold to see the counts, which will also update the conditional formatting of the latitude delta in meters. To get the same functionality in new dumps, sort by latitude and just copy the extra columns at the end and extend the formulas to new lines. Be careful, as this only displays the difference in one dimension!

lynxlynxlynx avatar Mar 10 '18 19:03 lynxlynxlynx

The exact duplicates have been removed (scripted via API).

lynxlynxlynx avatar Mar 15 '18 21:03 lynxlynxlynx