FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

Freezing some layers to enable fine-tuning on smaller gpus

Open luffycodes opened this issue 2 years ago • 0 comments
trafficstars

I was wondering if it's possible to freeze some layers in vicuna models, and if that will have smaller memory footprint to fine-tune the model?

luffycodes avatar Apr 23 '23 05:04 luffycodes