LabelSemantics

LabelSemantics copied to clipboard

关于句子长度的问题

1

作者您好，这段代码中，我有个疑问 def gen_features(tokens,labels,tokenizer,tag2id,max_len): tags,input_ids,token_type_ids,attention_masks,lengths = [],[],[],[],[] for i,(token,label) in enumerate(zip(tokens,labels)): sentence = ''.join(token) lengths.append(len(sentence)) if len(token) >= max_len - 2: label = labels[i][0:max_len - 2] label = [tag2id['O']] + [tag2id[i]...

MWXGOD

支持中文吗

1

Crescentz