CMU-MultimodalSDK-Tutorials icon indicating copy to clipboard operation
CMU-MultimodalSDK-Tutorials copied to clipboard

Unable to obtain testing accuracy as the tutorials

Open hyang428 opened this issue 5 years ago • 2 comments

Hi,

using the CMU-MOSI dataset: the testing accuracy in the tutorial is around 71.6%. I'm using the exactly same code from the tutorials, but I only get around 61.2% testing accuracy.

Any suggestion? or the author of CMU-MultimodalSDK has done something new to the dataset?

Thanks!

hyang428 avatar Jan 28 '20 12:01 hyang428

Not sure if this is still relevant, I'm guessing it could either be PyTorch updates or the SDK updates that made the difference. Maybe try something like PyTorch 1.0 to see if it gets ~70% acc, otherwise it's probably the SDK's data changed.

Justin1904 avatar Jun 27 '20 07:06 Justin1904

Hi, I also encounter the same problem.I changed the model verified in the published paper but i keep the same implementation process in this repository.And the result shows a huge decrease.Maybe is the torch package updates some setting?Can you give some better implementation process in this tutorial? Best wish

bourne-3 avatar Apr 08 '21 15:04 bourne-3