low-rank-adaptation topic

LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch

hkproj

Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

serp-ai

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

garyfanhku

[SIGIR'24] The official implementation code of MOELoRA.

liuqidong07