Magma icon indicating copy to clipboard operation
Magma copied to clipboard

Question about generating action trajectories (ToM?) with Magma

Open SustThomasYHT opened this issue 9 months ago • 0 comments

Hi Magma team,

First, thank you for releasing such an impressive model with both multimodal understanding and action planning capabilities!

I'm specifically interested in the model's ability to generate action trajectories for manipulation tasks. In the README, I notice there's a brief mention of "traj" but I couldn't find detailed information about how to extract trajectory outputs from the model.

Could you please provide:

  1. Example code for how to prompt the model to generate trajectories for robotic manipulation tasks
  2. Any specific formatting requirements for trajectory generation prompts
  3. Tips for getting the best trajectory predictions from the model

This would be extremely helpful for my research into multimodal AI agents.

Thank you!

SustThomasYHT avatar Mar 06 '25 11:03 SustThomasYHT