jwst
jwst copied to clipboard
CRDS OPS or PUB needs to be recorded in the FITS header
Currently the only 2 CRDS parameters stored in the science data headers are CRDS_VER and CRDS_CTX:
CRDS_VER= '11.16.3 ' / Version of CRDS file selection software used
CRDS_CTX= 'jwst_0932.pmap' / CRDS context (.pmap) used to select ref files
But there's no indication of whether this corresponds to https://jwst-crds.stsci.edu or https://jwst-crds-pub.stsci.edu.
This is important, as most scientists will be reporting they've used a particular CRDS_CONTEXT number, but that number is meaningless with knowing whether this is OPS or PUB. In fact it's likely to be misleading in science papers, as scientists will be certainly reprocessing their data at their home institutions using latest pmaps available and may be pointing to PUB because they're also using the latest version of jwst.
And of course the pmap names between OPS and PUB do not correspond to the same state of CRDS (unfortunately). Further, the meaning of all the R_* keywords will also be meaningless without knowing whether it is OPS or PUB, as the reffile names themselves are different too.
Perhaps a CRDS_SVR keyword with values that correspond to the CRDS_SERVER_URL env keyword, so basically the full URL as above would be helpful.
Documentation
Update the documentation indicating that CAL_VER, CRDS_CTX and CRDS_SVR are the most important keywords to report in papers. (My impression is that CRDS_VER doesn't matter for science.)
The documentation should probably urge scientists to report SDP_VER as well, as there are upstream to jwst updates that have nothing to do with CRDS_CTX or CAL_VER that will affect the metadata in the _uncal.fits files. I.e. telescope pointing keywords in _uncal.fits files were updated between SDP_VER=2022_2a and SDP_VER=2022_3.
The other thing that would be nice in terms of documentation is some sort of way to figure out what SDP_VER corresponds to in terms of the DMS build numbers. I assume that SDP_VER=2022_3 corresponds to DMS Build 8.1.2, but I don't see any way of finding that out. Perhaps the table here could add that as a column?
SDP_VER has been added to the version mapping table in the jwst README and CRDS-PUB is gone and hence irrelevant. So I'm closing this issue.