Avi Jain

False Negatives in the dataset

1

Hello, upon experimenting with the dataset I came across several examples where a hypernym relationship exists but is labelled as False (mostly novels). Here are a few examples from the...

Difference in behavior between fast tokenizers and normal tokenizers regarding unicode characters in strings

4

Hello, we recently switched from Python based tokenizers to the newer fast tokenizers and noticed some of our code breaking when the inputs contain unicode (emojis etc) characters, which wasn't...

Hello, I'm a little confused by the ymin - float array, the _top left corner_ of the bounding boxes; normalized coordinates and ymax - a float array, the _top edge_...