SessionRec-pytorch icon indicating copy to clipboard operation
SessionRec-pytorch copied to clipboard

Sementic Expander is really useful?

Open GyuminJack opened this issue 2 years ago • 3 comments

hello. I'm really benefiting from your research.

However, I have a question. I know that sementic expander can and does learn the longterm depency of nodes through the gru layer.

In this process, all the nodes that came in through the batch are made into a single line and entered into the GRU, which seems to leave room for unrelated nodes to be connected to each other.

What are your thoughts on this?

GyuminJack avatar Sep 07 '23 02:09 GyuminJack

Actually it will not make all the nodes into a single line and put them into GRU. Instead, only locally adjacent nodes are put into GRU at one time.

SpaceLearner avatar Apr 25 '24 15:04 SpaceLearner

thanks for you reply!

if then, coefficient set to be 0.5. is it hyperparameter which set by experiment? or 0.5 is best option on this model?

GyuminJack avatar May 09 '24 23:05 GyuminJack

It is set to 0.5 to equally weight the two part. There may be better combination.

SpaceLearner avatar May 14 '24 07:05 SpaceLearner