d2l-en icon indicating copy to clipboard operation
d2l-en copied to clipboard

Transformer encoder -> Transformer decoder

Open MassEast opened this issue 8 months ago • 0 comments

In section 11.9.3 Decoder-Only, it should say "GPT pretraining with a Transformer decoder" instead of "GPT pretraining with a Transformer encoder", just as depicted in Fig. 11.9.6

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

MassEast avatar Jun 19 '24 07:06 MassEast