llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

Published 20 hours ago • verified publisher icon mosaicml

Set eval shuffle to False

Open eldarkurtic opened this issue 2 years ago • 0 comments

I think eval dataloaders should not shuffle data for consistent evaluation results

eldarkurtic avatar Jun 07 '23 19:06 eldarkurtic