qlora topic

List qlora repositories

ms-swift

11.6k
Stars
1.1k
Forks
11.6k
Watchers

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v, Phi4,...

qwen_finetuning

83
Stars
7
Forks
Watchers

qwen-7b and qwen-14b finetuning

Finetuning-Suite

56
Stars
7
Forks
Watchers

Finetune any model on HF in less than 30 seconds

Sunsimiao

366
Stars
23
Forks
Watchers

🌿孙思邈中文医疗大模型(Sunsimiao):提供安全、可靠、普惠的中文医疗大模型

Firefly

6.6k
Stars
587
Forks
6.6k
Watchers

Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、In...

Firefly-LLaMA2-Chinese

396
Stars
31
Forks
Watchers

Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

MindChat

688
Stars
56
Forks
688
Watchers

🐋MindChat(漫谈)——心理大模型:漫谈人生路, 笑对风霜途

chatglm2_finetuning

144
Stars
17
Forks
Watchers

chatglm2 6b finetuning and alpaca finetuning

LongQLoRA

159
Stars
13
Forks
Watchers

LongQLoRA: Extent Context Length of LLMs Efficiently

llm_finetuning

96
Stars
12
Forks
Watchers

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on