SP Liew issues

Repositories
Issues
Comments

Results 3 issues of


                                            SP Liew

Data set

Hello, Very nice work! I have several questions about the data set used in this work. (I learned much about this work from this [slide](https://www.slideshare.net/PacSecJP/shusei-tomonaga-pacsec20171026)) - Do you have the...

About the bisection method used for converting RDP to approximate DP

Thanks for the great work! Not sure if I should submit the issue here, but let me just do it anyway. In the [paper](http://proceedings.mlr.press/v89/wang19b.html), it is suggested that one should...

Replacing MoE layers in every other transformer block

Hi guys, Instead of replacing all all FFN sub-blocks by MoE layers, I am attempting to replace MoE layers only in every other transformer block (like what the [Gshard](https://openreview.net/forum?id=qrwe7XHTmYb) paper...