alignn icon indicating copy to clipboard operation
alignn copied to clipboard

cross-validation comparison with ReLU and Swish

Open bdecost opened this issue 3 years ago • 0 comments

Benchmark ReLU vs Swish performance and workload -- I ran some informal comparisons between ReLU networks and swish networks this summer, but didn't record computational workload or run the tests in cross-validation. In the one-off comparison study I had done, ReLU and Swish networks gave roughly equivalent performance on JARVIS e_form and e_gap tasks, and we just switched to Swish networks from that point on

bdecost avatar Sep 30 '21 17:09 bdecost