LinXGBoost icon indicating copy to clipboard operation
LinXGBoost copied to clipboard

Feature request: is it possible to implemente a `Classification` in `LinXGBoost`?

Open bjmwang opened this issue 7 years ago • 3 comments

And will it perform better?

bjmwang avatar Sep 10 '18 00:09 bjmwang

If I remember well, for binary classification, it is just a matter of changing the objective function. I will have a look at it if I have some time. Will it perform better? It certainly depends on the problems at hand.

ldv1 avatar Sep 11 '18 06:09 ldv1

  1. In sklearn's GBDT, regression and classification (binary or multi) only differ in the loss function.

  2. Yes, as it always is. In fact, I meant the average performance over a set of various problems. Sorry for the ambiguities.

bjmwang avatar Sep 26 '18 07:09 bjmwang

Implementation for binary classification is done. I just added a test. I do not know at the moment how to extend it to multiclass. At the leaves, we have scores, and if the score is positive, then the label is 1 whereas if the score is negative, the label is 0. The extension to multiclass is thus not straightforward. I will look at sklearn implementation.

ldv1 avatar Oct 06 '18 18:10 ldv1