FoundationPose icon indicating copy to clipboard operation
FoundationPose copied to clipboard

bad result with custom data

Open eunseon02 opened this issue 1 year ago • 6 comments

I am testing with my custom data, but the tracking results are poor, as you can see below. Please take a look at the video after the 10-second mark.

Screencast from 04-29-2024 01_02_51 AM.webm

i attached my dataset folder https://drive.google.com/file/d/1bCer4uM1yyu9qPbB3Er2UBByZz7rNDs5/view?usp=sharing

I'm using the code from the comment https://github.com/NVlabs/FoundationPose/issues/44#issuecomment-2048141043 to generate data

eunseon02 avatar Apr 28 '24 16:04 eunseon02

me too .when i use the tracking style .the first frames goes well.but when time goes by.the pose goes wrong. 0 i think it may be caused by the model with little characters .the solution still have not be founded

cypacjy avatar Apr 29 '24 09:04 cypacjy

can you send your debug_dir for further check? Similar to https://github.com/NVlabs/FoundationPose/issues/83#issuecomment-2079709973

wenbowen123 avatar Apr 29 '24 16:04 wenbowen123

this is debug folder https://drive.google.com/file/d/1m3r68X6qD39excPoWWXjeba4Ly07EOGp/view?usp=drive_link

eunseon02 avatar Apr 30 '24 04:04 eunseon02

you did not allow permission

wenbowen123 avatar Apr 30 '24 16:04 wenbowen123

when you run FoundationPose, your model texture is not loaded. See vis_refiner.png

wenbowen123 avatar Apr 30 '24 19:04 wenbowen123

when you run FoundationPose, your model texture is not loaded. See vis_refiner.png

Thank you for your response. I tried again with a different dataset(using the code from #44, mask the mesh file with bundlesdf) but it still didn't work properly.

https://github.com/NVlabs/FoundationPose/assets/108911413/ca654baf-4394-4379-bc1d-d7d56612b696

https://github.com/NVlabs/FoundationPose/assets/108911413/0e0d24b0-e419-49fd-875f-0b2028af203e

this is the debug folder https://drive.google.com/file/d/1TwUg1oR6axPi1LKSSnBmxu3RFNfMVKfo/view?usp=drive_link https://drive.google.com/drive/folders/1m1ya5ZLovTmB1o6oRxs7cXV6EHTyK5Ch?usp=drive_link

eunseon02 avatar May 04 '24 11:05 eunseon02

@eunseon02 Hi, did you solve your tracking problem and if you solved it how you did?

liuchangji avatar May 15 '24 09:05 liuchangji