unitable icon indicating copy to clipboard operation
unitable copied to clipboard

Consistency between prediction and VALID_HTML_TOKEN

Open ygzhu opened this issue 7 months ago • 0 comments

Thanks for your contributions! I noticed that the VALID_HTML_TOKEN is composed of [""] and HTML_TOKENS in constant.py. VALID_HTML_TOKEN is used to filter the prediction during inference phase. But the annotation of "[" and "]" are not included in VALID_HTML_TOKEN. Does this omission affect the final prediction during the inference phase?

ygzhu avatar Jul 01 '24 06:07 ygzhu