CMU-MultimodalSDK icon indicating copy to clipboard operation
CMU-MultimodalSDK copied to clipboard

CMU-MOSEI: Updated csd files give different feature tensors compared to before

Open anita-hu opened this issue 4 years ago • 2 comments

On Jul 4 2020, I stored processed aligned tensors for the visual and audio features and used the raw words to create bert features. I noticed recently that a newly created dataset using the same code results in different features (I am using COVAREP, VisualFacet42 and TimestampedWords). It seems the csd files (in http://immortal.multicomp.cs.cmu.edu/CMU-MOSEI) have different file sizes and were last updated on Jul 20. I was wondering what changed with the feature csd files? I noticed the labels are the same when loaded as tensors but features are very different.

Thank you!

anita-hu avatar Jan 18 '21 03:01 anita-hu

Hi @anita-hu,

What we are hoping to achieve with the SDK is to keep updating the computational sequences with the newest features and most recent updates. These updates are mostly meant to make the features better and better over time. If by any chance you found any bugs in the new csd, please let me know.

A2Zadeh avatar Jan 29 '21 00:01 A2Zadeh

Hi @A2Zadeh,

Thank you for your response. Could you provide details on what was changed in the most recent MOSEI csd files after version 1.2.0? I noticed that the loaded features are different which led to not being able to recreate training results I had before using the previous version.

anita-hu avatar Jan 29 '21 01:01 anita-hu