Longformer_ZH

Longformer_ZH copied to clipboard

Sequence length should be multiple of 512. It can't directly used for encoding

1

File "D:\Anaconda\envs\torch_1.7\lib\site-packages\torch\nn\modules\module.py", line 727, in _call_impl result = self.forward(*input, **kwargs) File "D:\Anaconda\envs\torch_1.7\lib\site-packages\transformers\models\bert\modeling_bert.py", line 1068, in forward return_dict=return_dict, File "D:\Anaconda\envs\torch_1.7\lib\site-packages\torch\nn\modules\module.py", line 727, in _call_impl result = self.forward(*input, **kwargs) File "D:\Anaconda\envs\torch_1.7\lib\site-packages\transformers\models\bert\modeling_bert.py", line...

SouthWindShiB

feng-1985

请问原生longformer的Dilated sliding window这些能够使用吗

3

有注意到hugging face的longformerconfig里面好像没有加载这些参数的地方

Finnyhudson

文本匹配任务使用longformer能使用交互型模型吗

9

使用交互型模型感觉会长出长度限制导致后一文本被切断

Finnyhudson

spelling mistake?

1

``` 我们同样提供了Huggingface的自动下载 We also provide auto load with HuggingFace.Transformers. from Longformer_zh import LongformerZhForMaksedLM LongformerZhForMaksedLM.from_pretrained('ValkyriaLenneth/longformer_zh') ``` ImportError: cannot import name 'LongformerZhForMaksedLM' from 'Longformer_zh' LongformerZhForMaksedLM or LongformerZhForMaskedLM ?

guanwy1995