models icon indicating copy to clipboard operation
models copied to clipboard

[FEA] Adding feature-level attention

Open marcromeyn opened this issue 3 years ago • 0 comments

🚀 Feature request

Adding feature-level attention to Merlin-models.

Motivation

In our retrieval experiments we had multiple instances where a simple MF-model was outperforming a Two-Tower model. We suspect this is because some of the features that were passed to the two-tower model were quite noisy. We would like to give the model a chance to learn to ignore these features. Our hope is that that would lead to two-tower models performing at least as good as MF.

marcromeyn avatar May 18 '22 14:05 marcromeyn