Jack Duvall

icon indicating a website link https://duvallj.pw

icon company Roam HQ, Inc. icon location Brooklyn, NY icon location Software Engineer at @WonderInventions

Results 23 comments of Jack Duvall

Relative Positional Encoding

I was confused about this too, but I think the `attn_mask` functionality applied [here](https://github.com/kimiyoung/transformer-xl/blob/master/pytorch/mem_transformer.py#L260-L267) and initialized [here](https://github.com/kimiyoung/transformer-xl/blob/master/pytorch/mem_transformer.py#L649-L660) does the job.

linux or windows？

PyTorch and Tensorflow are cross-platform, but most of the scripts in this repository seem to be written assuming Linux.

Python SocketIO client can't connect to Socket.IO chat example server

Haven't looked to hard at this, but seems possibly related to https://github.com/feus4177/socketIO-client-2/issues/10. Basically this library (and the fork in the link) doesn't support socket.io protocol version 2.0. I remeber seeing...