Vedanuj Goswami

Vectorization of tanh

2

Recently I submitted a [PR](https://github.com/pytorch/pytorch/pull/7495) to the PyTorch Repo for a vectorized `tanh` implementation for single precision. The implementation is a vectorized version of [cephes math library's single precision](http://www.netlib.org/cephes/) `tanhf`...

Temperature scaled sampling for multi dataset

7

## 🚀 Feature Temperature scaled sampling for multi dataset ## Motivation In multitask training involving multiple datasets, it is often desirable to be able to control the sampling ratios for...

WIP FSDP integration from Fairscale