GroundingDINO icon indicating copy to clipboard operation
GroundingDINO copied to clipboard

LoRA finetuning

Open ThiagoViek opened this issue 1 year ago • 4 comments

In the LLMs field, people are going after foundation models and finetuning them to their own tasks using Low-rank Adaptation. Is it possible to leverage LoRA for finetuning Grounding DINO as well?

ThiagoViek avatar Jul 15 '23 16:07 ThiagoViek

In the LLMs field, people are going after foundation models and finetuning them to their own tasks using Low-rank Adaptation. Is it possible to leverage LoRA for finetuning Grounding DINO as well?

Sure, I think it's a good way to adapt Grounding-DINO in other long-tail domain task

rentainhe avatar Jul 18 '23 14:07 rentainhe

@ThiagoViek Hi, I'm also interested in finetuning grounding dino to fit some personal tasks. Have you ever tried lora on grounding dino? Looking forward for further discussion.

Nina0109 avatar Aug 05 '23 14:08 Nina0109

@ThiagoViek Remarkable ideas! Have you tried some experiments? Expecting for some feedback.

THUeeY avatar Apr 29 '24 09:04 THUeeY

https://github.com/BeileiCui/SurgicalDINO

This is something I found, but I am not sure if this is useful.

ahan-2000 avatar Jun 24 '24 10:06 ahan-2000