parameter-efficient topic

List parameter-efficient repositories
trafficstars

k-neural-api

133
Stars
106
Forks
Watchers

K-CAI NEURAL API - Keras based neural network API that will allow you to create parameter-efficient, memory-efficient, flops-efficient multipath models with new layer types. There are plenty of exampl...

AdaMix

124
Stars
10
Forks
Watchers

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

Alpaca-CoT

2.6k
Stars
246
Forks
Watchers

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to...

LLM-Adapters

967
Stars
86
Forks
Watchers

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"