peft-fine-tuning-llm topic

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

nbasyl

[SIGIR'24] The official implementation code of MOELoRA.

liuqidong07

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

UCDvision

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

brown-palm

[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

ROIM1998

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

TUDB-Labs

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

misonsky