Wildbook icon indicating copy to clipboard operation
Wildbook copied to clipboard
verified publisher icon WildMeOrg

Reporting an encounter doesn't consistently run default algorithms

Open goddesswarship opened this issue 1 year ago • 5 comments

Expected behavior Reporting an encounter (/submit.jsp or /import/instructions.jsp) for Giraffa tippelskirchi thornicrofti creates match results that includes both MiewID and Hotspotter algorithms.

Current behavior In GiraffeSpotter, reporting an encounter of Giraffa tippelskirchi thornicrofti creates match results that inconsistently includes both MiewID and Hotspotter algorithms, only Hotspotter results, or only MiewID results.

Community link https://community.wildme.org/t/new-entries-sometimes-miewid-sometimes-hotspotter/2940/7?u=anastasia https://community.wildme.org/t/pie-v2-only-match-results-without-miewid-results-for-crocuta-crocuta/3155/3 https://community.wildme.org/t/results-with-no-matches/3236

Investigation notes

Examples from user:

Only miewID on match page:

  • https://giraffespotter.org/iaResults.jsp?taskId=656e5694-5cf8-4de5-a4e8-042143c17c5e
  • https://giraffespotter.org/iaResults.jsp?taskId=cd0f99e6-cb31-41dd-adb4-23412f42be02
  • https://giraffespotter.org/iaResults.jsp?taskId=8286f6b5-7745-4ed9-92aa-b7eda5b1e537
  • https://giraffespotter.org/iaResults.jsp?taskId=b6ecec8a-943c-41b1-9c3e-edb81d427c35
  • https://giraffespotter.org/iaResults.jsp?taskId=306d9873-a6a4-429a-919e-164d9b95356f

Only Hotspotter on match page:

  • https://giraffespotter.org/iaResults.jsp?taskId=587a8518-ea84-4bb8-a53c-d6c729f33359
  • https://giraffespotter.org/iaResults.jsp?taskId=361854f4-8586-4ad1-80e8-4b2978fe2da1
  • https://giraffespotter.org/iaResults.jsp?taskId=7a30ade9-4c82-4d18-b8e9-225aadf092b1

Both:

  • https://giraffespotter.org/iaResults.jsp?taskId=91ced8e3-a7a8-4d5c-a664-44814d82d55d
  • https://giraffespotter.org/iaResults.jsp?taskId=02a9e38e-cf1d-49e0-9b78-0caa73d42e4b

@holmbergius suspects something in the config file. There's only one place where we define which algorithms to run and we always define MiewID and Hotspotter to run in parallell for this species. There's nothing in the file that will allow one algorithm to run independently of the other. May need @naknomum to evaluate.

@goddesswarship's test encounter where only Hotspotter was run for both annotations: https://giraffespotter.org/encounters/encounter.jsp?number=e1015f30-6479-4721-bbb3-9f157158c915

Image used for testing:

Image

Update 7/2/24 Similar issue reported for Crocuta crocuta in ACW. Depending on the root cause of the issue, these may be related. Verified that PIEv2 and MiewID should run together. These examples are also manual uploads reported through the Report an encounter page:

Only MiewID

  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=83c21341-19b7-441e-b1d4-ffe681c3151f
  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=58b4a2d3-c7bb-4e9d-94e9-e47aa7a96224

Only PIEv2

  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=4abc940b-d1c2-453f-b49c-4fc0d503ab7e
  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=e7f2e012-cb02-4729-bf8c-b6aa6a719fd6
  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=80da04a7-31e5-474e-90cc-b13e193039fb
  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=6dbabf6b-29c2-4c59-bc2d-656859bb3e6d

Both

  • https://africancarnivore.wildbook.org/iaResults.jsp?taskId=f48a0db6-dcf4-428b-81b7-5bcced436c6f
  • @goddesswarship's test encounter where both algorithms ran: https://africancarnivore.wildbook.org/iaResults.jsp?taskId=fee53ba7-1244-4fcf-98b9-51fe8bf24cda

Update 7/29/24 Also reported in Flukebook for beluga (Delphinapterus leucas) matches during bulk import. Only MiewID is configured for belugas, but this match result shows Hotspotter as the only algorithm: https://www.flukebook.org/iaResults.jsp?taskId=71722537-ba82-490e-9427-daca77c62e8d

Another annotation on the same image shows MiewID results: https://www.flukebook.org/iaResults.jsp?taskId=a3ad32ff-c568-4722-9706-34fdb5c3df80

goddesswarship avatar Apr 19 '24 18:04 goddesswarship

Assigned to @naknomum to evaluate per @holmbergius

goddesswarship avatar Apr 25 '24 17:04 goddesswarship

Added two new examples provided by user for MiewID-only and Hotspotter-only results.

goddesswarship avatar Jul 01 '24 21:07 goddesswarship

Updated ticket with examples from ACW. Leaving platform tag for now per @TanyaStere42

goddesswarship avatar Jul 02 '24 18:07 goddesswarship

Updated ticket with examples from Flukebook.

goddesswarship avatar Jul 29 '24 21:07 goddesswarship

Updated ticket to reflect this happens with bulk imports, too and not just manual uploads.

goddesswarship avatar Jul 30 '24 20:07 goddesswarship

Found to be a duplicate of #632 , resolved with #853

TanyaStere42 avatar Oct 30 '24 18:10 TanyaStere42