scenic icon indicating copy to clipboard operation
scenic copied to clipboard

Refactored DETR implementation on `optax` API.

Open MasterSkepticista opened this issue 1 year ago • 2 comments

Many functions and calls within existing detr implementation are deprecated in Flax as well as OTT.

This PR includes two major changes (all changes only under projects/baselines/detr):

  • Migrates from flax.optim to optax.
  • sinkhorn solver now uses updated ott-jax calls.

I have tested both configs for train/eval/checkpointing.

MasterSkepticista avatar May 13 '24 13:05 MasterSkepticista

Hi @MasterSkepticista, I am experimenting with your modified detr, I have encountered many environment conflicts and tried to resolve them, but there are still some difficult bugs, can you provide your environment as a reference. Thank you very much.

durianer-D avatar Aug 08 '24 09:08 durianer-D

@durianer-D I created a new repo with a minimal implementation. It is also significantly faster to train than this PR. https://github.com/MasterSkepticista/detr.

MasterSkepticista avatar Aug 16 '24 07:08 MasterSkepticista