xgboost-survival-embeddings icon indicating copy to clipboard operation
xgboost-survival-embeddings copied to clipboard

Xgbse.metrics scoring speeds

Open kmedved opened this issue 4 years ago • 1 comments

I've noticed it takes several times longer for xgbse to score the models using the built-in scoring functions (concordance_index/approx_brier_score) than it takes for the models to fit. Is this typical/expected behavior? On my data - approximately 800K rows, the model itself will fit in about 90 seconds, but scoring the model can take 4 minutes or more after.

This additional overhead is significant for the purposes of hyperparameter searching, so I am wondering if there is anything I can do to speed up the scoring (e.g., any parameters to tweak in the scoring functions?).

kmedved avatar Feb 10 '21 00:02 kmedved

This is not intended behavior but there isn't any parameter that will improve the scoring functions or any simple fix. We'll add the refactor and optimization of the scoring methods on our roadmap.

GabrielGimenez avatar Feb 10 '21 13:02 GabrielGimenez