qlora topic

List qlora repositories

ms-swift

3.6k
Stars
310
Forks
12
Watchers

Use PEFT or Full-parameter to finetune 350+ LLMs or 90+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Visio...

qwen_finetuning

83
Stars
7
Forks
Watchers

qwen-7b and qwen-14b finetuning

Finetuning-Suite

56
Stars
7
Forks
Watchers

Finetune any model on HF in less than 30 seconds

Sunsimiao

366
Stars
23
Forks
Watchers

🌿孙思邈中文医疗大模型(Sunsimiao):提供安全、可靠、普惠的中文医疗大模型

Firefly

5.8k
Stars
524
Forks
Watchers

Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、In...

Firefly-LLaMA2-Chinese

396
Stars
31
Forks
Watchers

Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

MindChat

592
Stars
47
Forks
Watchers

🐋MindChat(漫谈)——心理大模型:漫谈人生路, 笑对风霜途

chatglm2_finetuning

144
Stars
17
Forks
Watchers

chatglm2 6b finetuning and alpaca finetuning

LongQLoRA

159
Stars
13
Forks
Watchers

LongQLoRA: Extent Context Length of LLMs Efficiently

llm_finetuning

96
Stars
12
Forks
Watchers

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on