FActScore
FActScore copied to clipboard
AssertionError: `topic` in your data (Jessie Mae Brown Beavers) is likely to be not a valid title in the DB.
AssertionError: topic in your data (Jessie Mae Brown Beavers) is likely to be not a valid title in the DB.
hi @clawnotfound, thanks for reporting this issue. Did you use a custom prompt set / database?
hi @clawnotfound, thanks for reporting this issue. Did you use a custom prompt set / database?
Hello, @martiansideofthemoon. I'm experiencing the same issue, and I wanted to ask: Does the topic in the file we're trying to validate (the JSONL file) need to match exactly with the title in the custom database? I would appreciate your response. Thank you!