Pointers for ARuco Marker detection with Research Mode streams.

[michbaum]

Hi Mitchel,

First of all thank you for this amazing repo and your work in this area! I'm currently pursuing a project where we try to implement ARuco marker detection for augmented Infrared ARuco tags. Thus we would like to run something very similar to your pipeline, but on the short throw infrared camera stream. Your repo was a huge help in bringing those research streams into a unity project, but you mentioned that it would require more input processing to use the other streams for the Marker detection.

Do you have an idea/a pointer to the parts in your code where one would have to make these changes? Does the current ARuco marker detection pipeline expect black and white markers for example, and thus thresholding would be required etc.?

Also I was wondering if the current code that implements the different research streams already handles all the transformations from the headset to the specific camera sensor, or if that is currently assumed to be the front facing photo video camera (thus needing a separate calibration for the other camera streams).

Thanks for any help on this!