text
text copied to clipboard
pytorch
Models, data loaders and abstractions for language processing, powered by PyTorch
### 🐛 Describe the bug I was using `torchtext` to construct a vocabulary (v) and tokenize the input text. I just wanted to check the indices of the tokens and...
Shouldn't torch/text add an explicit dependency on portalocker now? Without it, I get: ``` = 979 failed, 204 passed, 12 skipped, 1 deselected, 6 warnings in 495.47s (0:08:15) = ```...
## 🐛 Bug **Describe the bug** torchtext.datasets.IWSLT2016 do not work. it always returns `HTTPError: 404 Client Error: Not Found for url: https://drive.google.com/uc?id=1l5y6Giag9aRPwGtuZHswh3w5v3qEz8D8` The website, which is supposed to maintain this...
Changes: Python base test: 3.10 (Release in march by Anaconda) Future Python 3.11 support Cuda 11.8 builds Cuda 12.0 builds
In document classification, or text summarization, the data is a document, precisely a sequence of sentences. How to use torchtext to preprocess a document into a matrix?
In #2023, after building torchtext for conda-forge, I noted: > If anyone is interested, I pushed a [branch](https://github.com/h-vetinari/torchtext/tree/conda_0.14) with the changes that were necessary to get this to work for...
## ❓ Questions and Help why am I getting different results in different cases (for example in jupyter and colab )? after the same code `import torchtext import torch from...
The `test_download_charngram_vectors` test is failing on CI for linux platforms due to the following error `urllib.error.HTTPError: HTTP Error 404: Not Found` (see [sample CI job](https://github.com/pytorch/text/actions/runs/4755755079/jobs/8520868662)). We currently disable the test...
## 🐛 Bug **Describe the bug** A clear and concise description of what the bug is. - PyTorch Version (e.g., 1.0): 1.12 - OS (e.g., Linux): - How you installed...
