Why the saved weight is 700k instead of 3M？

[Allen-lz]

I used the following command for fine tuning ` export MODEL_NAME="runwayml/stable-diffusion-v1-5" export INSTANCE_DIR="./data/data_disney" export OUTPUT_DIR="./exps/output_dsn"

lora_pti
--pretrained_model_name_or_path=$MODEL_NAME
--instance_data_dir=$INSTANCE_DIR
--output_dir=$OUTPUT_DIR
--train_text_encoder
--resolution=512
--train_batch_size=1
--gradient_accumulation_steps=4
--scale_lr
--learning_rate_unet=1e-4
--learning_rate_text=1e-5
--learning_rate_ti=5e-4
--color_jitter
--lr_scheduler="linear"
--lr_warmup_steps=0
--placeholder_tokens="|"
--use_template="style"
--save_steps=100
--max_train_steps_ti=1000
--max_train_steps_tuning=1000
--perform_inversion=True
--clip_ti_decay
--weight_decay_ti=0.000
--weight_decay_lora=0.001
--continue_inversion
--continue_inversion_lr=1e-4
--device="cuda:0"
--lora_rank=1
--use_face_segmentation_condition
` But the saved weight is only 700k

[rishabhjain]

That's because your lora_rank is 1 here. Increasing it will increase the size. A rank of 4 will roughly give ~3MB.

[Allen-lz]

That's because your lora_rank is 1 here. Increasing it will increase the size. A rank of 4 will roughly give ~3MB.

thanks!