generative-recommenders icon indicating copy to clipboard operation
generative-recommenders copied to clipboard

Published 20 hours ago • verified publisher icon facebookresearch

How to combine autoregressive model and classification multi-task head in ranking model?

Open MoFHeka opened this issue 8 months ago • 1 comments

If I understand correctly, autoregressive model has a loss, and also multi-task dense layers followed autoregressive model has a weighted loss. How to combine them? And in ranking model, how to calculate the loss of autoregressive model? It's the same as LLM which is cross-entropy? Or a softmax?

MoFHeka avatar Jun 03 '24 07:06 MoFHeka