jwst icon indicating copy to clipboard operation
jwst copied to clipboard

Populate wavelength extension for MIRI LRS slitless

Open tapastro opened this issue 1 year ago • 1 comments

Resolves JP-nnnn

Closes #

This PR adds a function to assign_wcs to populate the wavelength extension of the calints level 2 output for MIRI LRS slitless data.

Not sure if this is addressing pixel locations appropriately (0-indexed) or if this addition is warranted - brainstorming for recent issue #6963.

Checklist

  • [ ] added entry in CHANGES.rst within the relevant release section
  • [ ] updated or added relevant tests
  • [ ] updated relevant documentation
  • [x] added relevant milestone
  • [x] added relevant label(s)

tapastro avatar Aug 05 '22 17:08 tapastro

Codecov Report

Merging #6964 (bc81a5c) into master (390d8f9) will increase coverage by 0.01%. The diff coverage is 90.00%.

@@            Coverage Diff             @@
##           master    #6964      +/-   ##
==========================================
+ Coverage   79.57%   79.59%   +0.01%     
==========================================
  Files         411      411              
  Lines       37217    37242      +25     
==========================================
+ Hits        29616    29641      +25     
  Misses       7601     7601              
Flag Coverage Δ *Carryforward flag
nightly 79.54% <100.00%> (ø) Carriedforward from 1b736fb
unit 53.23% <88.88%> (+0.01%) :arrow_up:

*This pull request uses carry forward flags. Click here to find out more.

Impacted Files Coverage Δ
jwst/assign_wcs/util.py 83.59% <85.71%> (+0.02%) :arrow_up:
jwst/assign_wcs/assign_wcs.py 86.11% <100.00%> (+6.48%) :arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

codecov[bot] avatar Aug 05 '22 18:08 codecov[bot]

Rats, should've asked if you had run regtests on this before I merged it. I'm doing a run now and a handful of errors have already shown up in the log: https://plwishmaster.stsci.edu:8081/job/RT/job/JWST/1938/console

hbushouse avatar Aug 26 '22 14:08 hbushouse

Ah, sorry about that - slipped my mind. We should expect failures due to cal files having a populated extension, but I guess we'll have to see if there are any surprises.

tapastro avatar Aug 26 '22 15:08 tapastro

Yes, these are not failures/differences (which I would expect), these are ERRORs.

hbushouse avatar Aug 26 '22 15:08 hbushouse

I'm running test_miri_lrs_slitless locally right now to see if that's the one that's going bad.

hbushouse avatar Aug 26 '22 15:08 hbushouse

Yep, the LRS slitless test is now crashing in the photom step. I wonder if something in the photom step was also creating the 2D wavelength array and it doesn't need to do that anymore, since it should already be available in the input.

Oh, I wonder if the wavelength array needs to be 3D to match the shape of all the other data arrays when dealing with LRS slitless datasets coming from a rateints file.

hbushouse avatar Aug 26 '22 15:08 hbushouse

The change from the initial commit to the use of the bbox changed the wavelength array shape from the equivalent shape of the data to the shape of the bbox, which is smaller than the data array. This is causing a mismatch when applying an operation to the wavelength array.

tapastro avatar Aug 26 '22 16:08 tapastro

@nden Looking further into the relative indices, it appears that the use of bbox serves to truncate the first method to only include the non-nan extent - i.e. the bbox is working as expected, but it is a mismatch to the data array shape. Was the intent of the bbox use (i.e. the full frame coordinates mentioned above) meant to include the location on the full frame instead of the subarray? I tried to offset the indices generated in the first method by the xstart and ystart values defined in meta.subarray, but there is no defined wcs for those pixel positions.

tapastro avatar Aug 26 '22 18:08 tapastro

FWIW, bbox_grid appears to be in the same pixel-space as the original index_array (which had values x:{0:71}, y:{0:471}), but due to the truncation of the original space to exclude fully-nan regions, the extent of the bbox grid is x:{4:71}, y:{5:394}.

tapastro avatar Aug 26 '22 18:08 tapastro