Longformer_ZH icon indicating copy to clipboard operation
Longformer_ZH copied to clipboard

Published 20 hours ago • verified publisher icon ValkyriaLenneth

请问原生longformer的Dilated sliding window这些能够使用吗

Open Finnyhudson opened this issue 1 year ago • 3 comments

有注意到hugging face的longformerconfig里面好像没有加载这些参数的地方

Finnyhudson avatar Jul 11 '23 02:07 Finnyhudson

你可以看一下Longformer的源码设置,这个模型和原longformer结构完全一致,他那边的设置时间太长了,我不记得了

ValkyriaLenneth avatar Jul 11 '23 02:07 ValkyriaLenneth

感谢！

Finnyhudson avatar Jul 11 '23 02:07 Finnyhudson

请问这个模型的tokenizer应该用什么

18410080631 avatar May 29 '24 10:05 18410080631