mimic-code icon indicating copy to clipboard operation
mimic-code copied to clipboard

In BigQuery: missing derived tables in "mimiciv_2_2/mimiciv_3_1"

Open arielhasidim opened this issue 6 months ago • 6 comments

Missing tables:

  • rrt
  • colloid
  • sapsii
  • sofa
  • urine_output_rate
  • urine_output
  • ventilation
  • ventilator_setting
  • vitalsigns
  • weight_durations
  • phenylephrine
  • vasopressin

Relevant for:

  • mimiciv_2_2_derived
  • mimiciv_3_1_derived

But does exist for:

  • mimiciv_derived (see _metadata bellow)

Image

arielhasidim avatar Jun 16 '25 10:06 arielhasidim

When I pull the MIMIC-IV dataset into BigQuery, I only see mimiciv_3_1_derived (and the tables that you listed above are missing as noted above). How do I get mimiciv_derived within BigQuery? The instructions on physionet get me only the 3.1 (and the note there says that mimiciv is a mirror of 3.1)

vinhteq avatar Aug 08 '25 22:08 vinhteq

Bumping this post up as we hope to use the previous derived ventilation details for a project, thanks! Or is there an easy way to load in an older version in Bigquery? Tagging @alistairewj :bat-signal:

cloverbunny avatar Nov 04 '25 23:11 cloverbunny

Sorry I'm inpatient so also tagging @tompollard =D

cloverbunny avatar Nov 07 '25 20:11 cloverbunny

I'm ashamed to say that @alistairewj is a far better choice for this, even though he left our team several years ago! MIMIC isn't currently funded, so there is nobody really maintaining resources like the derived content, other than Alistair in his free time. I'll try to take a look but probably not until mid next week.

tompollard avatar Nov 07 '25 21:11 tompollard

Thank you guys for your service!~ 🙇‍♀️

cloverbunny avatar Nov 07 '25 21:11 cloverbunny

I just checked and it's fairly simple, the bq pagination stopped the copy from mimiciv_derived to mimiciv_3_1_derived

this means the full data is available on mimiciv_derived, just not copied over

@tompollard pr fix - https://github.com/MIT-LCP/mimic-code/pull/1947 we'd need to do a new release for the change to propagate to bq

alistairewj avatar Nov 08 '25 03:11 alistairewj