text

text copied to clipboard

torchtext.legacy.data not available

1

## 🐛 Bug **Describe the bug** A clear and concise description of what the bug is. torchtext.legacy.data module is not available in torchtext==0.11.0 (torch==1.11) **Environment** Please copy and paste the...

alvynabranches

`SentencePieceTokenizer` should return IDs _or_ pieces

3

## 🚀 Feature `SentencePieceTokenizer` (or similar) should return IDs. **Motivation** Currently using `SentencePieceTokenizer` as a transform requires a second transform which uses torchtext's `Vocab` abstraction in order to ID-ify the...

erip

Bug in CLIPTokenizer input handling

6

## 🐛 Bug **Describe the bug** The output of OpenAI's CLIP tokenizer is different than Torchtext's tokenizer, when using the same inputs & settings. **To Reproduce** Steps to reproduce the...

ProGamerGov

Regarding adding shuffling and sharding datapipes to in-built datasets

1

## 🚀 Feature **Motivation** * To avoid pitfall with shuffling and sharding of datapipes in distributed training environments * To ensure consistent experience of TorchData based datasets across domains. **Pitch**...

parmeet

Better Documentation for `merges_path` in `CLIPTokenizer`

2

## 📚 Documentation **Description** I didn't get what i need to provide for the class for it to work and there is no documentation on what is `merges_path` or what...

MohamedAliRashad

Add support for return_all_layers with nested tensor in torchtext

1

Summary: As we may automatically switch to use nested tensor, we need further support of this in torchtext, especially for return_all_layers Reviewed By: mikekgfb, parmeet Differential Revision: D36213184

zrphercule

Add TorchData as a required dependency in TorchText for 0.12.0 release

1

## 🚀 Feature TorchData is currently an optional dependency which means users have to `pip install torchdata` if they want to be able to use our datasets. Since datasets are...

Nayef211

Specified Field dtype <torchtext.legacy.data.pipeline.Pipeline object at ...> can not be used with use_vocab=False because we do not know how to numericalize it.

3

## ❓ Questions and Help **Description** I am trying to implement a sequence (multi-output) regression task using `torchtext`, but I am getting the error in the title. torch version: 1.10.1...

MSiba

## searching the ideal torchtext pipeline **Description** hey there, so ive been using the legacy version of torchtext for quite sometime as it provides easier ways to load custom dataset...

StephennFernandes

Revamp Pytorch Benchmark implementations for pytorch_struct and Attention is All You Need models

5

## 🚀 Feature Revamp Pytorch Benchmark implementations for pytorch_struct and Attention is All You Need models **Motivation** Since we deprecated pytorch.legacy, we need to revamp these tutorials to make them...

abhinavarora