RippleNet icon indicating copy to clipboard operation
RippleNet copied to clipboard

the relevance probability seems to no effect on final result

Open HuangLK opened this issue 6 years ago • 4 comments

Hi, I have used RippleNet on my dataset but can't get the explainability by tracking the paths to the item with high relevance probability in the KG. So I try to modify the source code: https://github.com/hwwang55/RippleNet/blob/ba7ce72f12b101575925d022ccdbab4b4b4cf91a/src/model.py#L98 After replacing the reduce_sum with reduce_mean, the line be:

    o = tf.reduce_mean(self.t_emb_list[hop], axis=1)

and I run these two version code on the movie dataset, and they both get the best result(AUC 0.92 ACC 0.84). BEFORE(ORIGINAL): image

AFTER: image

Could these results tell the truth that the relevance probabilities of the heads have no effect on the final result? If I misunderstand something, please let me know. Thx :)

HuangLK avatar Nov 06 '18 06:11 HuangLK

@hwwang55

HuangLK avatar Nov 20 '18 09:11 HuangLK

Relevance probabilities are more to provide explainability in MovieLens, since the performance on MovieLens is already high. Relevance probabilities are more effective in news dataset according to our results.

hwwang55 avatar Nov 20 '18 14:11 hwwang55

Hi, can you print the values of 'probs_expanded'? I have tired to do that, but met an issue ' You must feed a value for placeholder tensor 'memories_r_0' '. Can I get some help? thanks a lot

Liane-Wang avatar Jun 06 '22 10:06 Liane-Wang

@HuangLK

Liane-Wang avatar Jun 06 '22 10:06 Liane-Wang