aft-pytorch icon indicating copy to clipboard operation
aft-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon rish-16

How to init the additional param w?

Open wizardforcel opened this issue 1 year ago • 0 comments

I want to migrate a existing llm to this arch. There is a additional param w. How to init it?

wizardforcel avatar Jan 10 '24 06:01 wizardforcel