gpt4-structured-reporting icon indicating copy to clipboard operation
gpt4-structured-reporting copied to clipboard

testing with gpt4 API and getting "" in output after submitting a test case

Open pleabargain opened this issue 2 years ago • 3 comments

image json is empty image

test case attached testcase.txt

pleabargain avatar Jun 07 '23 09:06 pleabargain

confirmed bug JS console on latest chrome is free of errors or warnings

image

I used a test case provided on your site and JSON came back as "" HISTORY: The patient is a 53-year-old female presenting with right shoulder pain, with a request to evaluate for synovitis. COMPARISON: No prior studies are available for comparison. TECHNIQUE: A 3T MRI of the right shoulder was performed, including axial, coronal, and sagittal sequences with proton density fat saturation and T1- and T2-weighted images. FINDINGS: The MRI reveals minimal degenerative changes in the acromioclavicular joint. There is a small amount of fluid in the subacromial subdeltoid bursa and a moderate-sized glenohumeral joint effusion with synovitis. Mild bursal-sided fraying and tendinopathy of the distal supraspinatus tendon are seen, with punctate T2 hyperintensity at its insertion but no discrete tear. Mild tendinopathy of the subscapularis tendon is also noted. The remainder of the rotator cuff appears unremarkable. The intra-articular biceps tendon demonstrates minimal tendinopathy, while the extra-articular biceps tendon appears normal in location and appearance. A small paralabral cyst is adjacent to the anterosuperior labrum, measuring 5 x 3 x 2 mm, with associated tearing and partial detachment of the anterior and anteroinferior labrum. Mild degeneration of the posterior labrum is present as well. Mild subchondral cystic changes are seen in the anteroinferior glenoid, and minimal cystic change of the humeral head insertion of the interest in this tendon is observed. Linear signal subjacent to the superior humeral head cartilage, measuring 13 x 8 mm, is consistent with cartilage delamination. Cartilage thinning is also noted over the anteroinferior glenoid. No pathologically enlarged lymph nodes are identified, and muscle bulk and signal intensity appear within normal limits. IMPRESSION: Tearing and partial detachment of the anterior and inferior labrum with an adjacent small paralabral cyst. Cartilage delamination over the superior humeral head. Moderate glenohumeral joint effusion with synovitis.

pleabargain avatar Jun 07 '23 09:06 pleabargain

~Do you use GPT-4 API or 3.5? 3.5 is much harder to instruct correctly and will not provide good results. I think you still need to apply for GPT-4 API access. See also #4~

Just re-read the title. Sorry. I will look into this soon.

kbressem avatar Jun 07 '23 15:06 kbressem

Hello @kbressem ,

I read with great interest your manuscript: Leveraging GPT-4 for Post Hoc Transformation of Free-text Radiology Reports into Structured Reporting: A Multilingual Feasibility Study.

Wondering if the test implementation would be operational any time soon.

The testing only generates a blank json.

Look forward to hearing from you soon.

Thanks and Regards, Amit.

amitjc avatar Aug 08 '24 05:08 amitjc