Ali Safaya comments

Repositories
Issues
Comments

Results 2 comments of


                                            Ali Safaya

Adding GELU implementation

I tried to do that but I wasn't able to express the derivative using y only since the function has a complicated derivative form. Here is the paper of [GELU](https://arxiv.org/abs/1606.08415)...

Adding GELU implementation

Thanks!