Time-Series-Library icon indicating copy to clipboard operation
Time-Series-Library copied to clipboard

Questions about evaluating metric ACC

Open yichenwang231 opened this issue 1 year ago • 0 comments

Thanks for your work, when I reproduced the classification problem, I found that the results obtained by the validation set and the test set during the training process were inconsistent, and the results of the test set after the training was completed were also inconsistent with the results obtained during the training process. https://github.com/thuml/Time-Series-Library/blob/843ee18239b895b3018e7240002e85a0433e7f8b/exp/exp_classification.py#L128 https://github.com/thuml/Time-Series-Library/blob/843ee18239b895b3018e7240002e85a0433e7f8b/exp/exp_classification.py#L129 When I evaluate the validation set twice like this, the results will be different vali_loss, val_accuracy = self.vali(vali_data, vali_loader, criterion) vali_loss1, val_accuracy1 = self.vali(vali_data, vali_loader, criterion) print(val_accuracy,val_accuracy1 ) I don't know if it's due to randomness or other questions, but I'm looking forward to your answers.Thank you.

yichenwang231 avatar Oct 19 '23 02:10 yichenwang231