PaddleNLP
PaddleNLP copied to clipboard
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Searc...
模型训练完毕后,UIE抽取耗时目前稳定在20ms左右。 显卡为16GB,已设置fp16。 是否还有其他方法可使耗时能继续缩短?
- 版本、环境信息 1)PaddleNLP 2.3,PaddlePaddle2.3 2)系统环境:Linux,python3.7 3)batch_size=1,max_seq_lenth=512,train600条,test200条,dev200条 `# 模型训练: import paddle.nn.functional as F import time save_dir = "checkpoint/bert-wwm" if not os.path.exists(save_dir): os.makedirs(save_dir) save_train_result = "./results/bert-wwm.tsv" train_r_df = pd.DataFrame(data=None, columns=["global_step","epoch","step","loss","acc","time"]) pre_accu=0 accu=0...
### PR types New features ### PR changes Application ### Description
### PR types New features ### PR changes Others ### Description Use fastdeploy instead of inference backend
### PR types New features ### PR changes Models ### Description 【飞桨论文复现挑战赛(第六期)】111号论文 [CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://paperswithcode.com/paper/canine-pre-training-an-efficient-tokenization) 。添加 Canine 模型,复现仓库地址 [github](https://github.com/kevinng77/canine_paddle),[Aistudio](https://aistudio.baidu.com/aistudio/projectdetail/4063353?channelType=0&channel=0)。
`--------------------------------------------------------------------------- AssertionError Traceback (most recent call last) /tmp/ipykernel_182/1763430471.py in 3 4 schema = ['时间', '选手', '赛事名称'] ----> 5 ie = Taskflow('information_extraction', schema=schema) 6 pprint(ie("2月8日上午北京冬奥会自由式滑雪女子大跳台决赛中中国选手谷爱凌以188.25分获得金牌!")) /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlenlp/taskflow/taskflow.py in __init__(self, task, model, device_id,...
bvar is busy at sampling for 2 seconds! 模型训练的时候报这个错误! 使用的是py3.7, paddlepaddle是paddlepaddle-gpu -2.3.0.post112
### PR types New features ### PR changes Models ### Description add ernie-m unittest code
### PR types New features ### PR changes Others ### Description Add T5-based question generation example
### PR types Function optimization ### PR changes Models ### Description UnifiedTransformer tokenizer supports tokenizing special token.