Magma icon indicating copy to clipboard operation
Magma copied to clipboard

About ToM.

Open hahamini opened this issue 9 months ago • 1 comments

Where in the code can I see the ToM (algorithm2) mentioned in the paper? I would like to see the detailed code of the ToM algorithm using CoTracker.

And I wonder whether the segments using PySceneDetect in ToM contain semantic sub-goals in each video task.

However, I cannot find the code. I would appreciate your help.

hahamini avatar Mar 06 '25 05:03 hahamini

Will release the code soon this week!

jwyang avatar Mar 06 '25 07:03 jwyang

@jwyang Thanks for uploading the quick training code. I am more interested in ToM than overall training model. Which part should I check to test the ToM algorithm mentioned in the paper? (algorithm2)

hahamini avatar Mar 11 '25 04:03 hahamini

@hahamini , please follow this part to try the som_tom (Alg2) demo:

https://github.com/microsoft/Magma?tab=readme-ov-file#som-and-tom-generation

jwyang avatar Mar 16 '25 07:03 jwyang