meka icon indicating copy to clipboard operation
meka copied to clipboard

Single target result of J48 different to Weka

Open vutle opened this issue 6 years ago • 1 comments

Hi I'm testing a single target using BCC with J48.
The result seems to be different compared to Weka. E.g. Accuracy is 0.525 in Meka while 0.5 in Weka for cross validation.

Is the method implement different between the two? Shouldn't I get the same answer if it is a single target?

Thanks Meka N(test) 40 L 1
Hamming score 0.525 Exact match 0.525 Hamming loss 0.475 ZeroOne loss 0.475 Levenshtein distance 0.475 Label indices [ 0 ] Accuracy (per label) [ 0.525 ]


Weka Correctly Classified Instances 20 50 % Incorrectly Classified Instances 20 50 % Kappa statistic 0.2599 Mean absolute error 0.2036 Root mean squared error 0.4321 Relative absolute error 73.8882 % Root relative squared error 117.4604 % Coverage of cases (0.95 level) 55 % Mean rel. region size (0.95 level) 31 % Total Number of Instances 40

vutle avatar May 20 '18 10:05 vutle

Meka has different default parameters. For example, by default the dataset is randomized in Meka prior to cross validation, therefore the train/test sets may vary. Maybe that is the issue.

jmread avatar May 21 '18 17:05 jmread