graphstorm icon indicating copy to clipboard operation
graphstorm copied to clipboard

Evaluation metrics, e.g., accuracy and auc, can NOT be used at the same time

Open zhjwy9343 opened this issue 1 year ago • 0 comments

For a classification task, cannot use all metrics at the same time.

Examples: Accuracy and auc_roc requires different prediction return values. Therefore they cannot be used in one training/evaluation epoch.

Reasons: GS uses return_proba to control the types of prediction values, which means the predict function can NOT return both types of values.

Suggested solution:

  • Option 1: modify predict function to return both;
  • Option 2: based on the metrics given, run one or twice of the predict function.

zhjwy9343 avatar Oct 10 '23 20:10 zhjwy9343