rational_activations

rational_activations copied to clipboard

I am happy to find your innovative work! But when I tried to apply the Rational activation on ResNets for ImageNet training, I consistently got failed training (i.e., NaN). I...

SudongCAI

Installation commands in PyPi page are not working for with CUDA cases

1

I have all the requirements installed along with Python 3.6 and PyTorch 1.7.1 with CUDA 11.0. Now when I run ```pip3 install rational_activations``` it installs properly but while importing it...

tatban

Readme says by default PyTorch==1.9.0 supported, but internally it requires PyTorch==1.7.1

3

I have created an environment with python 3.9 and installed all the requirements ( numpy scipy matplotlib torch==1.9.0 tqdm termcolor) separately with cuda 11.1. But then when I am trying...

tatban

Comparison to Mish activation

7

Mish is the current most popular activation function. Thus, it would be good if you can also compare with it.

kayuksel

Tried to install from source with `python3 setup.py install --user` and got the error `airspeed.TemplateSyntaxError: line 6, column 8: expected ( in define definition, got: CHECK_CUDA(x) TORCH_CHECK(x.is_cuda ... ...` Turns...

hrpan

felixdivo