Loreto Parisi

flan t5 support

1

Assumed the tokenizer is the quite the same, is [flan t5](https://huggingface.co/google/flan-t5-base) supported?

AttributeError: 'NoneType' object has no attribute 'span'

2

I get this error ``` $ python main.py () *** WIKIPEDIA DATA ANALYSIS TOOLKIT *** () ---------------------------------------------------------- Executing ETL:RevHistory on lang: scowiki date: 20151201 ETL lines = 1 page_fan =...

ColBERT Wasm Demo

7

It would be worth to provide an example of using ColBERT passage retrieval from a user query as browser execution. A good example has been provide [here](https://colbert.aiserv.cloud/) for query-passage score...

When I try to extract a 3,1GB `.targz` archive, using this a stream pipe: ```javascript const decompressTargz = require('decompress-targz'); const stream = fs.createReadStream(tmpPath); const files = await decompressTargz()(stream); if(files &&...

Quantization with Incoherence Processing (QuIP) [code](https://github.com/jerry-chee/QuIP) has been released along with the paper. The LDLQ quantization algorithm described in the paper has been implemented, and it is built on top...

macOS M1 build error

2

While running on macOS M1 I get ```bash ERROR: Command errored out with exit status 1: /Users/loreto/opt/miniconda3/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/dr/lzd3czf922qcgj0xpdyg3dc40000gn/T/pip-install-3lhdxoh9/pycryptodome_3d5818659ba54c90872d4993a0d9e451/setup.py'"'"'; __file__='"'"'/private/var/folders/dr/lzd3czf922qcgj0xpdyg3dc40000gn/T/pip-install-3lhdxoh9/pycryptodome_3d5818659ba54c90872d4993a0d9e451/setup.py'"'"';f =...

Is there any comparison benchmark to [libIndic/IndicTrans](https://github.com/libindic/indic-trans)?

RuntimeError: each element in list of batch should be of equal size

1

### Bug description When running the example to train Llama3 from scratch with the Tensor Parallel example here https://github.com/Lightning-AI/pytorch-lightning/tree/master/examples/fabric/tensor_parallel using TorchTune as DataLoader of an unstructured dataset with a given...

NCCL error: Invalid rank requested

1

### Bug description Torch distributed on-prem run error. The env was set on the master was ``` 2024-08-20 18:18:44 WORLD_SIZE:8 NODE_RANK:0 MASTER_ADDR:192.168.1.1 MASTER_PORT:9001 ``` and on the client was seeing...

Using latents in CogVideoXPipeline pipeline

2

### Feature request / 功能建议 I'm trying to add `latents` ``` latents (torch.FloatTensor, optional) — Pre-generated noisy latents, sampled from a Gaussian distribution, to be used as inputs for image...