graphstorm icon indicating copy to clipboard operation
graphstorm copied to clipboard

[Change Request] Modify new `Evaluator` for the three tasks

Open zhjwy9343 opened this issue 11 months ago • 0 comments

The current GraphStorm Evaluators have misleading naming convention and lack of default metric. The new Evaluators will be task-specific.

Sample code

evaluator = gs.eval.GSgnnClassificationEvaluator(eval_frequency=100)

Requested changes

  1. Create GSgnnClassificationEvaluator, setting "accuracy" as default evaluation metric.
  2. Create GSgnnRegressionEvaluator, setting "mse" as default evaluation metric.
  3. Create GSgnnLinkPredictionEvaluator, setting "mrr" as default evaluation metric.

zhjwy9343 avatar Feb 27 '24 22:02 zhjwy9343