EvoTrees.jl icon indicating copy to clipboard operation
EvoTrees.jl copied to clipboard

Feature Request: piecewise linear gradient boosting tree

Open 1991jhf opened this issue 2 years ago • 2 comments
trafficstars

Hi, is there any plan to implement linear models at the leaves?

Similar to linear_tree in LightGBM. https://lightgbm.readthedocs.io/en/latest/Parameters.html#linear_tree https://github.com/microsoft/LightGBM/pull/3299

1991jhf avatar Jul 04 '23 06:07 1991jhf

It wasn't on my radar at the moment. Have you seen any evidence about added value such linear leaves may bring? If there's a compelling case, then it could help making a case for it. Otherwise, the 2 things I want to bring are support for ranking and obliveous (catboost style) trees.

jeremiedb avatar Jul 06 '23 03:07 jeremiedb

Hi, is there any plan to implement linear models at the leaves?

Similar to linear_tree in LightGBM. https://lightgbm.readthedocs.io/en/latest/Parameters.html#linear_tree microsoft/LightGBM#3299

You might be interested in MARS or the Julia implementation of MARS here, although the latter is pretty rough around the edges at the moment.

ParadaCarleton avatar Oct 14 '23 16:10 ParadaCarleton