retriv icon indicating copy to clipboard operation
retriv copied to clipboard
verified publisher icon AmenRa

Unreachable code

Open dantetemplar opened this issue 1 year ago • 0 comments

I guess this if-statement can not be reached. (no "punkt" key in dictionary).

https://github.com/AmenRa/retriv/blob/0c418a87f06a66e89d388ea3bf52575faf287d91/retriv/sparse_retriever/preprocessing/tokenizer.py#L17-L18

dantetemplar avatar Jul 08 '24 17:07 dantetemplar