SpeechGPT icon indicating copy to clipboard operation
SpeechGPT copied to clipboard

Published 20 hours ago • verified publisher icon 0nutation

Stage 2: number of trainable parameters

Open ehosseiniasl opened this issue 6 months ago • 0 comments

Hello,

I see number of trainable parameters in stage 2 is smaller than model parameters. Is this using PEFT?

Number of trainable parameters = 105,416,512

ehosseiniasl avatar Aug 22 '24 19:08 ehosseiniasl