DHCN icon indicating copy to clipboard operation
DHCN copied to clipboard

Calculation Method for Improv. (%) in Table 2 of the Paper

Open Desta0785 opened this issue 2 years ago • 0 comments

Hello,

I have a question regarding the calculation method for "Improv. (%)" as stated in Table 2 of the paper. The paper mentions that "The improvements are calculated by using the difference between the performance of S2-DHCN and the best baseline to divide the performance of the latter."

I interpreted this statement as:

$$\left( \frac{{\text{Performance of } S^2-\text{DHCN} - \text{Performance of best baseline}}}{{\text{Performance of best baseline}}} \right) \times 100%$$

For example, in the Tmall dataset with the metric P@10, the calculation would be:
$$\left( \frac{{26.22 - 23.41}}{23.41} \right) \times 100\ = 12 \neq 10.71\ \text{ (as stated in the paper)}$$ For metric M@10:
$$\left( \frac{{14.60 - 13.45}}{13.45} \right) \times 100\ = 8.55 \neq 7.87\ \text{ (as stated in the paper)}$$

Could you please clarify if my understanding is correct, or if there's another way the "Improv. (%)" value is being calculated?

Thank you!

Desta0785 avatar Aug 30 '23 13:08 Desta0785