keras-cv icon indicating copy to clipboard operation
keras-cv copied to clipboard

Published 20 hours ago • verified publisher icon keras-team

Support ViT model

Open tanzhenyu opened this issue 3 years ago • 10 comments

Transformer models are becoming more and more relevant. Let's support it by having ViT first. citing https://arxiv.org/pdf/2010.11929.pdf

tanzhenyu avatar Aug 05 '22 19:08 tanzhenyu

Happy to work on it.

sayakpaul avatar Aug 05 '22 19:08 sayakpaul

/cc @yuanliangzhe

bhack avatar Aug 05 '22 19:08 bhack

I am willing to work on this as well.

ariG23498 avatar Aug 06 '22 01:08 ariG23498

I am willing to work on this as well.

Thanks for providing the help! This is currently assigned, would you be open to contributing other transformer based vision models? for example, swin transformer

tanzhenyu avatar Aug 06 '22 03:08 tanzhenyu

Sure!

ariG23498 avatar Aug 06 '22 04:08 ariG23498

Sure!

https://github.com/keras-team/keras-cv/issues/671

Somehow I can't assign to you through user name...

tanzhenyu avatar Aug 06 '22 04:08 tanzhenyu

Somehow I can't assign to you through user name...

I think we need to comment on the issue to be assigned?

ariG23498 avatar Aug 06 '22 05:08 ariG23498

If this is not assigned I would love to take this up or help if needed.

deepwilson avatar Aug 09 '22 10:08 deepwilson

It's assigned.

image

sayakpaul avatar Aug 09 '22 10:08 sayakpaul

Sorry for the delay. But I still have it planned to contribute to this.

sayakpaul avatar Oct 13 '22 13:10 sayakpaul

I want to contribute to this issue, Can anyone guide me through. How to proceed with it..

cybergeekgyan avatar Dec 12 '22 02:12 cybergeekgyan

I want to contribute to this issue, Can anyone guide me through. How to proceed with it..

There is a PR at https://github.com/keras-team/keras-cv/pull/1014

bhack avatar Dec 13 '22 16:12 bhack