meshed-memory-transformer icon indicating copy to clipboard operation
meshed-memory-transformer copied to clipboard

Published 20 hours ago • verified publisher icon aimagelab

Vocabulary of the test split

Open gondimjoaom opened this issue 1 year ago • 0 comments

Hi! Thanks for the written paper and the availabe code.

I have what may be a stupid question, but I didn't find a straight answer to it anywhere:

When evaluating the model with the karpathy test split, some words might not be present on the vocabulary from the train split. What do you do? Simple remove these words from the captions of the test split?

gondimjoaom avatar Nov 25 '22 17:11 gondimjoaom