openxr-steamvr-passthrough icon indicating copy to clipboard operation
openxr-steamvr-passthrough copied to clipboard

Open Brush stroke marks are visible on my laptop screen, but not in the headset

Open lexvandersluijs opened this issue 1 year ago • 3 comments

Hi, Thanks for this great work! Do have a question: I'm having some trouble getting Open Brush to work with this add-on....

Some info:

  • both were downloaded today, the Open Brush version is 2.1
  • I see the registry key, and the passthrough installer says it is installed. This is confirmed by checking the layer list in openxr-explorer
  • It's again confirmed by the round button that I see in the main menu in VR (opened by pressing the small round button on the Index controller), just to the left of the center rectangle: there is an OpenXR button there, and when I press it I see the status screen.
  • this status screen shows that an overlay is requested, and when I change some settings, the system responds

So, so far so good. But when I try the Open Brush app, I see my own live environment but no 3D elements. I can actually paint something, but this then appears in the VR disiplay on my laptop monitor, not in 3D.

While trying things, I think at some point I saw an option called "Passthrough" in a 3D menu in Open Brush, but since then it has disappeared and I can't find it again...

The fact that I can see 3D elements on the laptop screen but not in the headset leads me to the hypothesis that perhaps the camera image is being draw over the 3D world, instead of behind it? The blend mode that I see in the info panel is Alpha Blend. Changing this to another value does not solve the issue.

Any idea what might be causing this? Maybe it's caused by a change in Open Brush?

Late addition: when I check the box 'Force passthrough' and set the mode to Additive, I do see my drawings appear in MR, but the camera image is a bit washed out (due to the additive blending with the VR background of course). Perhaps this is how the tool is supposed to work at the moment?

lexvandersluijs avatar Mar 03 '23 16:03 lexvandersluijs

As far as I know, Open Brush has not added proper support for this yet, and are still working on it. For it to work properly, they will need to submit alpha channels with the frames to mask out what needs to be drawn over the passthough.

At the moment, the additive override is the best way to use it. It works best with a dark background and bright brushes.

Rectus avatar Mar 03 '23 18:03 Rectus

Ah, thanks, that's good to know!

Perhaps it's a good idea to add some text about this to the readme? If you want I can try to create a first version for this, just let me know.

ptc-lexvandersluijs avatar Mar 03 '23 19:03 ptc-lexvandersluijs

I'll have to think about how to document it best.

Rectus avatar Mar 03 '23 20:03 Rectus