peft-fine-tuning-llm topic

List peft-fine-tuning-llm repositories

Large-Language-Model-Notebooks-Course

1.7k
Stars
424
Forks
1.7k
Watchers

Practical course about Large Language Models.

DoRA

124
Stars
4
Forks
124
Watchers

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

MOELoRA-peft

184
Stars
20
Forks
184
Watchers

[SIGIR'24] The official implementation code of MOELoRA.

NOLA

56
Stars
4
Forks
56
Watchers

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

AntGPT

25
Stars
2
Forks
25
Watchers

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

APT

46
Stars
2
Forks
46
Watchers

[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

MoE-PEFT

127
Stars
17
Forks
127
Watchers

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

HiFT

21
Stars
2
Forks
21
Watchers

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

FineTuningLLMs

560
Stars
75
Forks
560
Watchers

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"