Soft-Decision-Tree icon indicating copy to clipboard operation
Soft-Decision-Tree copied to clipboard

PyTorch Implementation of "Distilling a Neural Network Into a Soft Decision Tree." Nicholas Frosst, Geoffrey Hinton., 2017.

Results 3 Soft-Decision-Tree issues
Sort by recently updated
recently updated
newest added

Hello, I'd like to ask if I want to make regression prediction and output_ Dim = = 1, is SDT applicable (it seems to be only used for classification model?)...

Thanks for your implementation, very insightful! Anyway, why training accuracy is so low? ![image](https://user-images.githubusercontent.com/83947886/133087307-486dbbc3-ab83-491d-b4ec-7224c7340525.png) I have been choosing your default hyperparameters and setting. Thanks!

Hello, In the original article, they say "In order to avoid very soft decisions in the tree, we introduced an inverse temperature β to the filter activations prior to calculating...