Older IMU rotation and position self calibrate with camera?
So a couple weeks ago I found out about a project similar to slime in the sense it's imu based trackers but that had one extra element I found fascinating, instead of compensating for drift based on previous resets, it used a little camera that was snapped on with a mount to the headset to realign the trackers based on the camera working as a separate more accurate reading of the rotation and position of the body. Neat thing is that it was only for keeping the trackers calibrated, this was probably cause using a camera for fbt is difficult and you can't do fast movements without loosing tracking. My question is, would it be possible to implement something like this on slimes? Be it a head mount or a static camera it would solve so many issues that the older slimes tend to have with rotation and position. There are already solutions that can track a person body/ skeleton based solely on image so maybe it's a viable thing to look into?
It was actually something that we wanted to try in the future when we have more space on our roadmap or more resources. Or if someone makes that...
@Zelsias https://bsky.app/profile/slimevr.dev/post/3lqcx7gwt6k2u :)
Thats doing slime through slam, which does use cameras, but the proposed thing is putting a camera on the headset to compensate drift. I think there was some company who did basically exactly that but i dont remember who it was anymore