prime-reportstream icon indicating copy to clipboard operation
prime-reportstream copied to clipboard

CA - Duplicate Results Being Sent From ReportStream

Open Jcavallo7 opened this issue 10 months ago • 11 comments

Problem statement

From: [email protected]

User is receiving an influx of duplicate results lately via ReportStream into CalREDIE.

What you need to know

Being sent under the CLIA of CDPH000085.

The duplicates started on 1/27/25.

image.png image.png image.png

To do

Implement fix to avoid duplicates being sent.

Jcavallo7 avatar Jan 31 '25 23:01 Jcavallo7

Hey @victor-chaparro please take a look into this discrepancy?

MikaelahD13 avatar Feb 01 '25 01:02 MikaelahD13

@Jcavallo7 We have reviewed some of these duplicates and have identified that we think most of them are sender input errors from SimpleReport senders. I am setting up a time to review this with the SimpleReport team and will include you and @TaneaY on the invite.

As of now, we do not have any clear answer to provide CA. But if you'd like to provide a status update to them, I think you can indicate something along the lines of "ReportStream is actively investigating the issue to determine the root cause. We will be working with our senders next week and can provide an update."

chris-kuryak avatar Feb 03 '25 22:02 chris-kuryak

Thank you all, Ill send them a status update in the meantime!

Jcavallo7 avatar Feb 04 '25 16:02 Jcavallo7

Met today between SR, RS, and Support team. Next steps outline:

  1. Investigate why some messages were marked as duplicates -- RS will provide Support team with accession numbers and verbiage to respond to Manifest/CA. Support team will comm back to user.
  2. Investigate if/why some senders are sending the same "Test_Performed_Code" for multi-plex test results on different conditions -- we think this is triggering duplicates on the CA side, and SR is going to investigate (with the example Victor provided in Slack) if this is a SR Sender issue.

chris-kuryak avatar Feb 11 '25 20:02 chris-kuryak

@Jcavallo7 Here is some suggested content to respond to CA/Manifest with:

To help us troubleshoot the reasoning for all of these being marked as duplicates, can you provide the reason why the results for the following two accession numbers were marked as duplicates? And if it is because they were received a previous date/time, can you provide what date/time they were received and from what source? (Assuming it was not ReportStream.)

  • 1261669
  • PRO6850201
  • 973055

chris-kuryak avatar Feb 14 '25 20:02 chris-kuryak

@Jcavallo7 a quick update:

Glenn Grieves had a meeting with CA today and relayed the latest information:

  • RS has changed the max batch size to 400 items and reduced the send cadence to once per 10 min

This seems to have fixed the issue as we have not seen any more spikes in duplicates.

Per Glenn, Ellaison at CA will be checking to see if they are continuing to see the issues. RS will continue to monitor for a bit longer to ensure the issue has been resolved.

chris-kuryak avatar Mar 12 '25 19:03 chris-kuryak

Still awaiting response from Manifest. Victor sent email on Tues Mar 18.

chris-kuryak avatar Mar 20 '25 16:03 chris-kuryak

Linked with #15588

chris-kuryak avatar Mar 20 '25 16:03 chris-kuryak

Continuing to troubleshoot with Manifest.

davidcalabrese0324 avatar Apr 24 '25 16:04 davidcalabrese0324

Got script for Manifest. @victor-chaparro running into some issues still, but working through it.

davidcalabrese0324 avatar Apr 28 '25 16:04 davidcalabrese0324

@victor-chaparro set up a meeting to sync and get on the same page with Manifest. Every message we send to CA test environment it fails, but works on our side.

davidcalabrese0324 avatar May 08 '25 16:05 davidcalabrese0324