LESS icon indicating copy to clipboard operation
LESS copied to clipboard

Published 20 hours ago • verified publisher icon princeton-nlp

some question about calulate socre？

Open smashfan opened this issue 9 months ago • 1 comments 

N_SUBTASKS = {"mmlu": 57, "bbh": 27, "tydiqa": 9} 
influence_score = influence_score.reshape(
            influence_score.shape[0], N_SUBTASKS[target_task_name], `-1).mean(-1).max(-1)[0]

what is meaning N_SUBTASKS , why do this? Can I change it to " influence_score =influence_score.mean(-1)[0]" ?

smashfan avatar May 10 '24 02:05 smashfan