Arun Prakash A

icon indicating a website link arunprakash-a.github.io icon indicating an email [email protected]

icon company AI4Bharat, IIT Madras icon location India icon location Researcher @ AI4Bharat

Results 3 issues of Arun Prakash A

use biased estimate of std in layernorm as in the original paper

The original [paper](https://arxiv.org/pdf/1607.06450.pdf) computes a biased estimate of sample standard deviation. However, by default, `torch.Tensor.std()` uses an unbiased estimate [Ref](https://pytorch.org/docs/1.11/generated/torch.Tensor.std.html?highlight=torch%20std#torch.Tensor.std). Therefore, it is necessary to use `torch.Tensor.std(-1,unbiased=False)`. Moreover, the class...

Passing a list of integers instead of a list of strings to torchtext.voca.lookup_indices CRASHES the kernel

1 comment

### 🐛 Describe the bug I was using `torchtext` to construct a vocabulary (v) and tokenize the input text. I just wanted to check the indices of the tokens and...

added doctring to SchedulerType class

5 comment

# What does this PR do? It adds the docstring for the class `SchedulerType` . Currently, the AutoDoc only displays the `__call__ ` signature of `enum.EnumType` base class which is...