minGPT-tuned icon indicating copy to clipboard operation
minGPT-tuned copied to clipboard

Published 20 hours ago • verified publisher icon BlinkDL

what is the block_size

Open jia-yan opened this issue 1 year ago • 1 comments

self.time_weight = nn.Parameter(torch.ones(self.n_heads, self.block_length, self.block_length)) what is the block_size?

jia-yan avatar Mar 16 '23 02:03 jia-yan

same question

Xiloy avatar Jan 03 '24 07:01 Xiloy