pytorch-openai-transformer-lm

pytorch-openai-transformer-lm copied to clipboard

Can someone explain this line?

4

If my understanding is correct this is finding the places where there is delimiter and filters for them. How does this help with training? https://github.com/huggingface/pytorch-openai-transformer-lm/blob/253ca422bbf94b19da2a4aa8f1b294e01ab8be37/model_pytorch.py#L207

teucer

Clarifying last step of the 'transform_roc' function

7

Thanks for the implementation, it is a big help! I'm trying to wrap my head around the code and I had some questions here and there. One of them was...

sharpsy

Having various network heads

1

Hi! In the research paper, the authors tackle many different problems using the same base architecture, it is one the main strength of this article. Unfortunately, the actual version of...

rodgzilla

what is the use of dropout in the Transformer?

2

https://github.com/huggingface/pytorch-openai-transformer-lm/blob/55ba4d78407ae12c7454dc8f3342f476be3dece5/model_pytorch.py#L161

teucer