Swin-Transformer icon indicating copy to clipboard operation
Swin-Transformer copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Any Plans for release Swin-V2 Gaint?

Open ckddls1321 opened this issue 3 years ago • 1 comments

I'm very interested in training giant model.

Especially, trying to reproduce Swin-V2-G.

Does MS-Asia will have plan to release Swin-V2 codes? Or could you guide me to how to impl Swin-V2-G novel sequential operation?

  1. Which way should I choose to re-impl Swin-V2-G novel sequential operation?
  • By activation checkpoint?
  • By custom autograd that enables FWD/BWD sequential operation?

ckddls1321 avatar Mar 14 '22 07:03 ckddls1321

Swin-V2 Giant has been implemented in timm https://github.com/rwightman/pytorch-image-models/pull/1150

If you train a Swin-V2-G model, please submit a PR on the linked repo!

lapp0 avatar Apr 21 '22 17:04 lapp0