keras-nlp icon indicating copy to clipboard operation
keras-nlp copied to clipboard
verified publisher icon keras-team

Add sam2

Open innat opened this issue 8 months ago • 5 comments

https://github.com/facebookresearch/sam2

Also, is it possible to fine-tune keras-sam on custom dataset? or current implementation only for inference?

innat avatar Apr 22 '25 08:04 innat

@divyashreepathihalli would probably know re inference. If we don't support it we should add it.

I don't see why we wouldn't want SAM 2, so SGTM to add. Are you looking to contribute this one?

mattdangerw avatar Apr 30 '25 23:04 mattdangerw

Are you looking to contribute this one?

Not at the moment. I was exploring options for fine-tuning SAM on 3D data and came across this method, which supports both images and videos.

innat avatar May 01 '25 06:05 innat

@mattdangerw @divyashreepathihalli If nobody is working on it, I would like to add this one.

pctablet505 avatar May 08 '25 05:05 pctablet505

or current implementation only for inference?

Only for inference when I wrote it. I never tested training so I wonder how much effort is required to support it. I can try to train and compare the gradients to PyTorch impl when I get some time.

tirthasheshpatel avatar May 10 '25 22:05 tirthasheshpatel

@tirthasheshpatel Thanks. It would be really helpful.

innat avatar May 11 '25 11:05 innat