transformer-walkthrough
transformer-walkthrough copied to clipboard
'h' is not defined
Hi!
Thanks for sharing your cool walkthrough!
When combining the attention heads in the encoder, it seems like 'h' is not defined. Did you mean to say 'num_heads'?
Thanks!
Yes. That's correct.