pytorch-openai-transformer-lm icon indicating copy to clipboard operation
pytorch-openai-transformer-lm copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

what is the use of dropout in the Transformer?

Open teucer opened this issue 7 years ago • 2 comments

https://github.com/huggingface/pytorch-openai-transformer-lm/blob/55ba4d78407ae12c7454dc8f3342f476be3dece5/model_pytorch.py#L161

teucer avatar Jul 05 '18 16:07 teucer

A discussion about this code is happening in #11.

rodgzilla avatar Jul 09 '18 12:07 rodgzilla

@rodgzilla have seen it, thx.

It seems that self.clf_dropout is not used used anywhere. Do we need it at all?

teucer avatar Jul 09 '18 13:07 teucer