supervised-finetuning topic

List supervised-finetuning repositories

xtuner

3.8k
Stars
302
Forks
28
Watchers

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

sft_datasets

416
Stars
33
Forks
Watchers

开源SFT数据集整理,随时补充

AlignLLMHumanSurvey

679
Stars
30
Forks
Watchers

Aligning Large Language Models with Human: A Survey

InternLM-XComposer

2.5k
Stars
152
Forks
Watchers

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

Awesome-Knowledge-Distillation-of-LLMs

574
Stars
35
Forks
Watchers

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vert...

sdft

86
Stars
4
Forks
Watchers

[ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".

magpie

429
Stars
46
Forks
Watchers

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

InstructionModelling

23
Stars
7
Forks
Watchers

[NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"

AugCon

15
Stars
0
Forks
Watchers

Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularity