pnlp-mixer icon indicating copy to clipboard operation
pnlp-mixer copied to clipboard

Published 20 hours ago • verified publisher icon maum-ai
→

Metadata

Unofficial PyTorch Implementation for pNLP-Mixer: an Efficient all-MLP Architecture for Language (https://arxiv.org/abs/2202.04350)

Results 4 pnlp-mixer issues
Sort by recently updated
recently updated
newest added

Using a SentencePiece Vocabulary

Hi! Do you have an example of how to use this with a Sentence Piece vocab? I see that you have the `sentencepiece_extractor.py` file, but it's not clear how to...

dgrahn avatar dgrahn

would like to ask where can I download data to train / test pMLP-Mixer?

7 comment

Didn't find a clue to get the datasets, so I ask here. It's not an issue related to the implementation.

tiendung avatar tiendung

Questions Regarding the model

1. The XL models intent accuracy are ~1% away from mBERT in general, and in some of the language subcategories. Even though on the surface a hypothetical XXL model would...

BradKML avatar BradKML

how to do tokenization and feature extraction given one sentence? Do you have relevant inference code?

SkylerZheng avatar SkylerZheng

← Metadata

59
Stars
8
Forks
Watchers

Owner

verified publisher icon maum-ai

Metadata

Unofficial PyTorch Implementation for pNLP-Mixer: an Efficient all-MLP Architecture for Language (https://arxiv.org/abs/2202.04350)

Back