How can I get the contribution of each modality?

[antecede]

Dear Justin,

I saw the article in https://towardsdatascience.com/multimodal-deep-learning-ce7d1d994f4, but I did not see the code about the contribution of each modality. Besides, I saw some descriptions about the loss function on the website https://purvanshi.github.io/documents/Multimodalppt.pdf, when I saw the code I could not find where it is.

Thank you very much and I am looking forward to your reply.

Best wishes

[Justin1904]

This repo implements this specific paper. I don't see how it relates to the two links you shared, except that the broader topic is all on multimodality. If you are looking for where the different modalities are fused together, it is here. For the loss function, the paper I referred to as well as this repo does not propose/implement any novel loss function and uses a conventional L1 loss for regression here.