RoFormer_pytorch
RoFormer_pytorch copied to clipboard
transformers支持junnyu/roformer_v2_chinese_char_base了吗?直接用也没报错
直接用也没报错
from transformers import AutoTokenizer, RoFormerModel import torch
tokenizer = AutoTokenizer.from_pretrained("junnyu/roformer_v2_chinese_char_base") model = RoFormerModel.from_pretrained("junnyu/roformer_v2_chinese_char_base")
inputs = tokenizer("Hello, my dog is cute", return_tensors="pt") outputs = model(**inputs)
last_hidden_states = outputs.last_hidden_state
last_hidden_states
能这样用吗?
https://colab.research.google.com/drive/11WW68vCRtTr3qZyridqgchEgBaDMqu4P#scrollTo=1iVgO57UoAsq