gfi-bot icon indicating copy to clipboard operation
gfi-bot copied to clipboard

A Systematic Evaluation of The Trained ML Model

Open hehao98 opened this issue 2 years ago • 2 comments

To align with the requirements of a research paper, the following evaluations need to be conducted:

  1. Comparison with alternative models (LightGBM, Logistic Regression, SVM, DNN, and Random Forest)
  2. Ablation studies on features (along multiple dimensions of features)
  3. Feature importance analysis
  4. Showing the advantage of automated hyperparameter tuning

All evaluation data should be stored in the MongoDB database (for visualization in the frontend in the future).

hehao98 avatar Oct 12 '22 09:10 hehao98

Could you assign the tasks to people? :-)

minghuizhou avatar Oct 12 '22 10:10 minghuizhou

Could you assign the tasks to people? :-)

Runzhi has invited Haonan for some of the frontend tasks, but we are not sure which one he will work on first, so these tasks are still unassigned.

Runzhi also told me that the frontend code base is a little bit difficult to understand, maybe we need to invest some time to digest the code itself before we can assign frontend tasks to others ;<

hehao98 avatar Oct 12 '22 11:10 hehao98