parameter-efficient-fine-tuning topic

List parameter-efficient-fine-tuning repositories

Awesome_Matching_Pretraining_Transfering

434
Stars
49
Forks
434
Watchers

The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insigh...

DePT

94
Stars
15
Forks
Watchers

[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

SPT

61
Stars
2
Forks
Watchers

[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.

PETL_AST

35
Stars
3
Forks
Watchers

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of...

UniPT

63
Stars
1
Forks
Watchers

[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"

DoRA

591
Stars
36
Forks
Watchers

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

MOELoRA-peft

184
Stars
20
Forks
184
Watchers

[SIGIR'24] The official implementation code of MOELoRA.

Exploring the potential of fine-tuning Large Language Models (LLMs) like Llama2 and StableLM for medical entity extraction. This project focuses on adapting these models using PEFT, Adapter V2, and Lo...

PPT

17
Stars
3
Forks
Watchers

[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"