keras-cv icon indicating copy to clipboard operation
keras-cv copied to clipboard

Update current FPN for the extra level support. This is an extension that is used by the Retina-net application

Open qlzh727 opened this issue 2 years ago • 3 comments

What does this PR do?

Update current FPN for the extra level support. This is an extension that is used by the Retina-net application.

We could use this as the proper replacement for https://github.com/keras-team/keras-cv/blob/master/keras_cv/models/object_detection/retina_net/internal/layers/feature_pyramid.py

Fixes # (issue)

Before submitting

  • [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [x] Did you read the contributor guideline, Pull Request section?
  • [ ] Was this discussed/approved via a Github issue? Please add a link to it if that's the case.
  • [x] Did you write any new necessary tests?
  • [ ] If this adds a new model, can you run a few training steps on TPU in Colab to ensure that no XLA incompatible OP are used?

qlzh727 avatar Sep 21 '22 18:09 qlzh727

/gcbrun

qlzh727 avatar Sep 21 '22 18:09 qlzh727

Chatted with @tanzhenyu offline for this. We will park this PR for now since this is only going to be used by the Retina-net and not blocking the segmentation model. We will revisit this when we clean up the Retina net model code.

qlzh727 avatar Sep 21 '22 22:09 qlzh727

Chatted with @tanzhenyu offline for this. We will park this PR for now since this is only going to be used by the Retina-net and not blocking the segmentation model. We will revisit this when we clean up the Retina net model code.

Sounds good to me.

LukeWood avatar Sep 21 '22 22:09 LukeWood

Chatted with @tanzhenyu offline for this. We will park this PR for now since this is only going to be used by the Retina-net and not blocking the segmentation model. We will revisit this when we clean up the Retina net model code.

Have you chatted about RetinaMask for the segmentation to reuse the same RetinaNet backbones? https://arxiv.org/abs/1901.03353

bhack avatar Oct 20 '22 20:10 bhack

Have you chatted about RetinaMask for the segmentation to reuse the same RetinaNet backbones?

See also the related thread we had with @tanzhenyu at https://github.com/keras-team/keras-cv/issues/920#issuecomment-1278279734

bhack avatar Oct 21 '22 00:10 bhack

Thanks for the work on this @qlzh727 - @jbischof has been working on a new version of the FPN, and I think that the design has changed a LOT since this PR - so lets close this for now. Please re-open if you feel there is something in here we should consider, and we can update the code going forwards!

LukeWood avatar Mar 07 '23 20:03 LukeWood

SGTM.

qlzh727 avatar Mar 07 '23 21:03 qlzh727