astroquery icon indicating copy to clipboard operation
astroquery copied to clipboard

MAST cloud dataset doesn't show level 3 data products

Open bmorris3 opened this issue 7 months ago • 0 comments

I'm trying to load a JWST level 3 observation from AWS. I run:

from astroquery.mast import Observations 

Observations.enable_cloud_dataset()

obs = Observations.query_criteria(obs_collection='JWST',
                                  filters='F090W',
                                  instrument_name='NIRCAM/IMAGE',
                                  proposal_id='2731',
                                  dataRights='PUBLIC')
products = Observations.get_product_list(obs)

The resulting products contain only levels 1 and 2

>>> set(products['calib_level'])
{1, 2}

The corresponding level 3 data products are available on AWS, and you can see them with the AWS CLI like so:

$ aws s3 --no-sign-request ls s3://stpubdata/jwst/public/jw02731/L3/t/o001/
2024-02-27 20:26:37    8177157 jw02731-o001_t017_nircam_clear-f090w_cat.ecsv
2024-02-27 20:23:57 5414328000 jw02731-o001_t017_nircam_clear-f090w_i2d.fits
2024-02-27 20:26:35   16300589 jw02731-o001_t017_nircam_clear-f090w_i2d.jpg
2024-02-27 20:26:41       4076 jw02731-o001_t017_nircam_clear-f090w_i2d_thumb.jpg
2024-02-27 20:26:31  492192000 jw02731-o001_t017_nircam_clear-f090w_segm.fits
...

Are level 3 products intentionally separated from levels 1 and 2? Is there a way to query for them?

bmorris3 avatar Jul 12 '24 20:07 bmorris3