peft topic

List peft repositories

simple-llm-finetuner

2.0k
Stars
133
Forks
Watchers

Simple UI for LLM Model Finetuning

xtuner

5.0k
Stars
395
Forks
5.0k
Watchers

A Next-Generation Training Engine Built for Ultra-Large MoE Models

DePT

94
Stars
15
Forks
Watchers

[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

lightning-mlflow-hf

54
Stars
7
Forks
Watchers

Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow

llms_paper

236
Stars
10
Forks
Watchers

该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记(多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT)

LLaMA-LoRA-Tuner

438
Stars
85
Forks
Watchers

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

DAG_Scheduling

47
Stars
7
Forks
Watchers

HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling

LLamaTuner

617
Stars
65
Forks
617
Watchers

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

llama-trl

180
Stars
23
Forks
Watchers

LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA

transformers-code

1.8k
Stars
271
Forks
Watchers

手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube