GraphMAE icon indicating copy to clipboard operation
GraphMAE copied to clipboard

Graph Classification Accuracy Calculation?

Open gdreiman-insitro opened this issue 10 months ago • 0 comments

Hi thanks for the very interesting work.

I am wondering about how the metrics for the graph classification were calculated. In the paper, Table 2 is labeled at "Accuracy (%)". In both the DGL and pyg versions of this repo, it seems like F1 is calculated but reported as accuracy?

DGL

evaluate_graph_embeddings_using_svm calculates F1 here graph_classification_evaluation returns the return of evaluate_graph_embeddings_using_svm (test_f1) here test_f1 is appended to acc_list here final_acc is the mean of acc_list here

pyg

evaluate_graph_embeddings_using_svm calculates F1 here graph_classification_evaluation returns the return of evaluate_graph_embeddings_using_svm (test_f1) here test_f1 is appended to acc_list here final_acc is the mean of acc_list here

Is the code in the repo what was used to generate the results in the paper? I am having trouble replicating some results and wondering if the results in the paper are accuracy or F1.

Thank you

gdreiman-insitro avatar Apr 05 '24 21:04 gdreiman-insitro