CeiT-pytorch icon indicating copy to clipboard operation
CeiT-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon rishikksh20

Question about parameters Initialization

Open ChenyuChen1 opened this issue 4 years ago • 1 comments

Hello, I'm appreciate that your work help me a lot. I have a question that dose Transformer model need parameters initialization?

ChenyuChen1 avatar May 25 '21 04:05 ChenyuChen1

@ChenyuChen1 Did you train a CeiT transformer from scratch?

khawar-islam avatar Jun 24 '21 01:06 khawar-islam