noclip.website icon indicating copy to clipboard operation
noclip.website copied to clipboard

VR mode shows black screen both on Oculus quest and Cardboard

Open eggnot opened this issue 4 years ago • 9 comments

Both Oculus and smartphone showing black screen entering VR. There is no option "XR sandbox..." on current chrome version on both as well

eggnot avatar Jan 14 '22 17:01 eggnot

Yeah, the VR support is currently broken. Unfortunately, I do not have a headset or a way to test it myself. Last I checked, it worked fine on the XR emulation extension.

magcius avatar Jan 14 '22 20:01 magcius

Tested on Oculus Quest 2 64 GB model, both on a local server and on the noclip.website. The VR Option is there and it works in compatible browsers (both Firefox Reality and built-in Oculus browser) - but on every tested browser the scenery seems to be broken while rendering on certain titles, both while using VR and non-VR view of the website, so it seems it's a per-title problem. I only tested a handful, here are the results:

Doesn't work properly:

  • Team Fortress 2 - only renders water (tested on 2-fort map)
  • Mario Kart Wii - renders all-black textures, aside from speed-up tracks (tested on Luigi's circuit map)

What renders as intended (no issues detected on multiple maps):

  • Super Mario 64 DS
  • Psychonauts (side note - camera move speed seems to be better optimized for VR, as it is slower than in many other titles)
  • Luigi's Mansion for the Gamecube

XR emulation (via Chrome extension) renders all the maps fine though, the issue only occurs on the physical device.

jrupinski avatar Apr 06 '22 00:04 jrupinski

Unless someone is able to debug the actual device, I can't really contribute here. I am happy to assist someone who wants to understand how the VR mode is architected, but given that it works on the WebXR emulation extension, I do not think I am doing anything majorly wrong here...

magcius avatar Apr 06 '22 00:04 magcius

Thanks to some community members, I identified one potential issue fixed in 8c36ec1ffa81c61dc56bf7df9a3c1dbb4cc5654d.

magcius avatar Apr 06 '22 08:04 magcius

This seems to fix the issue with VR mode on PC based on community reports.

Standalone VR headsets still seem to have rendering issues in some specific games. Fixing this would probably require going through each of the games to find the problematic ones, and comparing (maybe replacing?) code with one that renders correctly (like Super Mario 64 DS).

Resources for someone with a Quest 2 headset and willing to try and fix this:

  • Viewer::renderWebXR is the entry point
  • https://developer.oculus.com/documentation/web/webxr-perf-renderdoc/

A video to illustrate the problem:

https://user-images.githubusercontent.com/9074800/162080727-99ef1324-cb22-4c5d-b485-ca903ad5b193.mp4

jrupinski avatar Apr 06 '22 22:04 jrupinski

I've got an HTC Vive Index and I've noticed some of the maps (Both Mario Galaxies, Wii Sports, Wind Waker, and more) render strangely to where two very different images render in both eyes and cause the maps to not show up properly.

Here's some videos to show:

Funcitoning Map (Okami): https://github.com/magcius/noclip.website/assets/66492208/387b40e6-aa59-40a8-a4bc-e424a694b5fa

Broken Map (Super Mario Galaxy): https://github.com/magcius/noclip.website/assets/66492208/09af9ab8-621b-474b-ad85-1308d809b8a2

chandler05 avatar Jun 30 '23 20:06 chandler05

I tried using the WebXR API Emulator extension, and the render looked correct to me... I do not have a personal device to test with.

image

magcius avatar Jun 30 '23 22:06 magcius

My take:

  • Device: Quest 2
  • Map: Luigi Circuit - Mario Kart Wii
  • The app doesn't produce any relevant errors in the console.
  • Screenshot: image
  • Screenshots of webglreport.com on the device as well as on my phone (works fine on the phone, both Qualcomm Adreno): https://imgur.com/a/0OZYhJt (KHR_parallel_shader_compile and OES_draw_buffers_indexed extensions are missing on the device)

I have no experience working with low-level graphics, so I don't think I can figure it out, but I'll continue my research.

maximxlss avatar Oct 13 '23 12:10 maximxlss

What doesn't work (black textures):

  • All Wii games
  • Some Gamecube games (e.g. Metroid Prime)

What does work:

  • Some Gamecube games (e.g. Luigi's Mansion)
  • All other games I tried.

maximxlss avatar Oct 13 '23 13:10 maximxlss