MiniGPT4-video icon indicating copy to clipboard operation
MiniGPT4-video copied to clipboard

Are there any randomness in inference?

Open 2000ZRL opened this issue 9 months ago • 0 comments

I found that the inference results on my customized dataset are different if I run the evaluation code for multiple times. I fix the batch size to 4, and the "shuffle" of dataloader is set to False. I don't use "low_resource" during inference. However, if I fix the seed, the results will be consistent. Any clues on why this happened? Thanks.

2000ZRL avatar May 01 '24 08:05 2000ZRL