aayux comments

Repositories
Issues
Comments

Results 13 comments of


                                            aayux

Self attention for pooling linear classifier

The OOM issue persists even on Colab with 11GB of GPU memory. ``` RuntimeError: CUDA out of memory. Tried to allocate 8.41 GiB (GPU 0; 11.17 GiB total capacity; 10.26...

Self attention for pooling linear classifier

@tpietruszka One intuitive reason why I think this could be helpful is that the way we had planned on using XNLI was by concatenating the premise and the hypothesis --...

Self attention for pooling linear classifier

The memory "leak" was my own fault. I changed the way I was using attention and that fixed it. Self attention module seems to be working okay on the tests...