hummingbird icon indicating copy to clipboard operation
hummingbird copied to clipboard

Performing simple inference

Open maxwellflitton opened this issue 2 years ago • 3 comments

Thanks for creating such a great library. I went through the math in the README and then created some simple data that would mimic the decision tree in the README and trained a basic DecisionTreeClassifier. After this, I got the state_dict of the model which in the debugger looked like the following:

Screenshot 2023-09-15 at 13 55 00

Does this mean that if I have an input tensor, and I merely loop through the matrices performing matrix multiplications in order to get accurate outcomes? I'm asking this because I am looking into performing inference with as few dependencies as possible. Ideally, I'd like to build a compiled program in Rust that just loads those weights and performs the matrix multiplications to get predictions.

maxwellflitton avatar Sep 15 '23 12:09 maxwellflitton