aorsf icon indicating copy to clipboard operation
aorsf copied to clipboard

leaf-adjacent models for explainability

Open bcjaeger opened this issue 9 months ago • 0 comments

this is an idea to make oblique RFs more explainable for a single prediction:

  1. pull out the regression coefficients from the node directly above the given obervation's predicted leaf node of each tree
  2. aggregate them
  3. use the aggregate regression coefficients as a starting value in a regression model fitted to the training set
  4. (optional) weight the training set by nearest neighbors of the observation

We would assess the validity of this by measuring correlation between the forest's predictions and the model's predictions. It would necessitate fitting 1 model per prediction, so not computationally great.

bcjaeger avatar Nov 16 '23 13:11 bcjaeger