text icon indicating copy to clipboard operation
text copied to clipboard

Add sentencepiece to BERT model

Open zhangguanheng66 opened this issue 4 years ago • 1 comments

In the XLM-R model, SentencePiece is used to tokenize the strings. We enable the sentencepiece processing pipeline here for the BERT workflow.

zhangguanheng66 avatar Jan 20 '21 23:01 zhangguanheng66

Codecov Report

Merging #1124 (7d50cd8) into master (9053d95) will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #1124   +/-   ##
=======================================
  Coverage   79.46%   79.46%           
=======================================
  Files          47       47           
  Lines        3175     3175           
=======================================
  Hits         2523     2523           
  Misses        652      652           

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 9053d95...7d50cd8. Read the comment docs.

codecov[bot] avatar Jan 20 '21 23:01 codecov[bot]