SteamVR-for-Linux icon indicating copy to clipboard operation
SteamVR-for-Linux copied to clipboard

Half Life Alyx repeated, location based steamvr crash

Open DreamingRaven opened this issue 4 years ago • 39 comments

Describe the bug In city 17, after opening the combine gate, the area behind the first opened door causes steamvr beta and standard steamvr to crash, killing the headset (screen off, and reset to blue state), and then subsequently the game.

To Reproduce Steps to reproduce the behavior:

  1. Go to and open the first combine gate in the first zone after the first train
  2. Open the following door
  3. Head across/ into the room behind this now opened door
  4. Headset freeze, pause, headset reset.

Expected behavior Continued operation, allowing motion across the room, and to be able to continue the rest of the game.

System Information (please complete the following information):

  • Distribution: Arch
  • SteamVR version: 1.10.32
  • Steam client version: Mar 20 2020 at 18:25:30
  • Opted into Steam client beta?: Yes
  • Graphics driver version: 440.64
  • Gist for SteamVR System Information: https://gist.github.com/DreamingRaven/a3d3c520f73a2a41eb09d8d208efb5d8

Screenshots This image is the last thing rendered before steamvr crashes every time, in the exact same location. image

Additional context here is the core dump in journalctl that is given. https://gist.github.com/DreamingRaven/5b88bc0f192b285a679fcf86e4b99ec6 Teminal output at the point of failure:

shaders/vulkan/linepixelsim_cs.spv
shaders/vulkan/linepixelsim2_cs.spv
shaders/vulkan/testgrid_cs.spv
shaders/vulkan/motionvector_cost_cs.spv
c:\buildslave\steam_main_win64\build\src\common\video\videoplayer.cpp (235) : Assertion Failed: !m_strURL.IsEmpty() || m_bufFromMemory.TellPut() > 0
crash_20200323235434_1.dmp[6502]: Uploading dump (out-of-process)
/tmp/dumps/crash_20200323235434_1.dmp
crash_20200323235434_1.dmp[6502]: Finished uploading minidump (out-of-process): success = yes
crash_20200323235434_1.dmp[6502]: response: CrashID=bp-78fe6ebf-6e45-4e87-88ea-8212a2200323
crash_20200323235434_1.dmp[6502]: file ''/tmp/dumps/crash_20200323235434_1.dmp'', upload yes: ''CrashID=bp-78fe6ebf-6e45-4e87-88ea-8212a2200323''
Warning: The game hasn't rendered a frame from us in over 10 seconds
Warning: The game hasn't rendered a frame from us in over 10 seconds

Note: Commenters who are also experiencing this issue are encouraged to include the "System Information" section in their replies.

DreamingRaven avatar Mar 23 '20 23:03 DreamingRaven

Unless you are that friend, a friend of me also ran into this ;). Are you? :). PS I didn't reach this point yet,.. The frame rate is too low to enjoy the game :( .. and that while I bought an RTX 2080 Super for this.

CarloWood avatar Mar 24 '20 05:03 CarloWood

Unless you are that friend, a friend of me also ran into this ;). Are you? :). PS I didn't reach this point yet,.. The frame rate is too low to enjoy the game :( .. and that while I bought an RTX 2080 Super for this.

Fraid not @CarloWood . However im surprised you have an FPS issue with a RTX 2080 super, im running with a 2070 and its pretty smooth for the most part with minor head turn stutter, and this weird steamvr crash.

DreamingRaven avatar Mar 24 '20 07:03 DreamingRaven

From my understanding of the situation, there appears to be a memory leak in Alyx when ran with Proton that causes your vram to get filled up regardless of how powerful your system is. Then, when the game tries to load something new, it somehow manages to cause SteamVR, and by extension, itself, to crash.

https://github.com/ValveSoftware/Proton/issues/3681

I found that saving immediately before entering a loading menu then restarting the game generally manages to be fast enough to evade a crash.

Head stuttering seems to be rather common and I experienced it during the early stages of the game myself. It does seem to stabilize later on though. As of current, apart from the loading issue, the game runs well enough to be very much playable.

System Info:

OS: Arch Linux x86_64 Kernel: 5.5.11-zen1-1-zen GPU: GTX 980 running 440.64 SteamVR: Version 1.10.32 (1584924836) HMD: Vive

llamasking avatar Mar 24 '20 08:03 llamasking

I tried your workaround, and thus far it is working to let me get through the loading screens as you said it might. Thanks, at-least I can continue playing somewhat (to experience the fear, the evil devs! :D).

DreamingRaven avatar Mar 24 '20 12:03 DreamingRaven

The frame rate is too low to enjoy the game :( .. and that while I bought an RTX 2080 Super for this.

However im surprised you have an FPS issue with a RTX 2080 super, im running with a 2070 and its pretty smooth for the most part with minor head turn stutter

I have 2080ti and it's also unplayable. Even on lowest details average FPS is barely enough for 120Hz and what's worse, FPS drops frequently (I guess few times a minute). :frowning_face: After first crash in the train, I stopped playing, the stuttering was making me sick.

mnn avatar Mar 24 '20 15:03 mnn

Reduce the resolution. It's the only way to have a fluid experience. I put it down to 40% at 90Hz on my 5700 XT and everything's smooth until the VRAM fills or a loading screen crashes. It's quite disappointing that it runs so badly but I imagine the native Vulkan version will be much better.

Edit: there goes that... next section, horrible lag spikes despite setting the resolution even lower.

Zamundaaa avatar Mar 24 '20 17:03 Zamundaaa

I can also confirm that I get a consistent crash after boarding the first train (during a loading transition). Other than this the game is running really well for me. I have a relatively moderate machine (Ryzen 3600 + RTX 2070) and the performance has been really good!

rstrube avatar Mar 24 '20 20:03 rstrube

Unless you are that friend, a friend of me also ran into this ;). Are you? :). PS I didn't reach this point yet,.. The frame rate is too low to enjoy the game :( .. and that while I bought an RTX 2080 Super for this.

Fraid not @CarloWood . However im surprised you have an FPS issue with a RTX 2080 super, im running with a 2070 and its pretty smooth for the most part with minor head turn stutter, and this weird steamvr crash.

I'm also running on o 2070 and my experience has also been positive. Perhaps try lowering the refresh rate to 90?

rstrube avatar Mar 24 '20 20:03 rstrube

Not having any big performance issues here either (2080 Ti). I did lower my screen to 80 Hz and I assume it picked up my default for Legacy reprojection. Mostly smooth and only rarely dropping a frame. Aside from the shader compile stutters, which can only be solved by waiting for a complete pre-compiled shader download. Then I crashed again after getting the Italian achievement.

edwin-v avatar Mar 24 '20 21:03 edwin-v

On a 2080TI and Ryzen 3900X here. Getting both the stutters and the level-transition crash. Tried setting the refresh from 144Hz to 90Hz, same deal. Turned off advanced supersampling, same deal. Haven't tried on SteamVR beta yet, gonna give that a go tomorrow. Running through Entanglement back to back but hey, at least it's pretty :)

Heavy stutters always happen:

  • Right after you talk to the first girl and CP's start flooding in.
  • Crossing the second courtyard leading up to the synth-flyby and getting to the elevator.
  • The playground while following the drone.
  • Right before and during entry into the lab.
  • After getting the gloves and going down into the courtyard.
  • Finishing off with the crash when fading to black after getting on the train..

ZarathustraDK avatar Mar 24 '20 22:03 ZarathustraDK

Hello, please opt into SteamVR's beta and retest (https://steamcommunity.com/games/250820/announcements/detail/2100307193365803538).

kisak-valve avatar Mar 25 '20 01:03 kisak-valve

Just tested the latest SteamVR Beta. Alyx no longer immediately fills my gpu memory but it does eventually fill up. I am not surprised about that since I have a 980, which only has 4GB of memory.

After beating that dark part of chapter 3, the loading screen after the door still causes my game and SteamVR to crash. I am also still barely reaching 90fps looking at the performance graph.

Luckily, loading a save and immediately jumping into the loading screen still evades a crash.

Latest update to Alyx does not change anything from the looks of it.

llamasking avatar Mar 25 '20 01:03 llamasking

Firstly, thanks for all the efforts supporting Linux!

Unfortunately, the latest Steam VR beta update and the Alyx game update doesn't resolve the crashing during the loading transition between levels for me. I've also noticed a crash when attempting to load a auto save checkpoint after dying, and when attempting to quit to the main menu.

I've been using the trick of saving directly before a level transition, quiting the game, restarting and the loading the save. This has allowed me to progress through this phenomenal game.

I have an RTX 2070 with 8GB VRAM, I will report back with better logs and and system information later.

Thanks!

rstrube avatar Mar 25 '20 06:03 rstrube

I am also still seeing vrcompositor crashes when loading.

DerRidda avatar Mar 25 '20 16:03 DerRidda

Opted into the beta. Same as before, heavy stutter in specific places and crash after entering the train. Gist: https://gist.github.com/ZarathustraDK/901c29aa935f4545f03e2da1d3bbf379 Waiting a bit after crash I get this error, which is strange because I'm fully up-to-date at 1.11.1 error

Any particular logs needed? I'll need to know which and where.

Edit: Here's a proton.log from a crash at a level-transition (the train). steam-546560.log

Edit 2 (SLIGHT SPOILER AHEAD): I also get the crash if I'm far enough into a chapter, save the game and then reload the save without exiting the game. Here's a proton-log where I saved just before entering the vort's place then tried to reload it: steam-546560.log

ZarathustraDK avatar Mar 25 '20 18:03 ZarathustraDK

I think similar behaviour to that of Alyx crashing on load can be seen in other games. Compound (615120) for example also gets progressively more choppy the more loading screens there are.

It's actually a very good example because for VR it's very low on resources and loads maps that are of very similar visual complexity as long as you are progressive within the same "theme". Yet the performance keeps degrading with every new map.

DerRidda avatar Mar 29 '20 12:03 DerRidda

I think similar behaviour to that of Alyx crashing on load can be seen in other games. Compound (615120) for example also gets progressively more choppy the more loading screens there are.

It doesn't really get progressively more choppy for me (Well I stopped progressing at chapter 3 waiting for a fix), it's more like it always get choppy at particular points whether or not you just loaded in prior to that point. The crashing-bug feels more like something in the game goes "Oh, I see you've loaded this much into vRAM, I'll let you play smoothly for now, but next level-transition I'll crash your HMD".

It's actually a very good example because for VR it's very low on resources and loads maps that are of very similar visual complexity as long as you are progressive within the same "theme". Yet the performance keeps degrading with every new map.

Yeah, there's a painfully obvious shader-compiling-stutter when you open up the quarantine zone and the scenery goes from City 17 to Xen-like biome.

ZarathustraDK avatar Mar 29 '20 13:03 ZarathustraDK

Hi everyone, So there's a couple things that I've noticed that I think might shed some light on the problem.

If I set my texture quality down from High to Medium, I can play longer before the crashes occur. Today I was able to get through a couple loading screens, but then on the third the game crashed. This does seem to support the theory that the GPU VRAM just fills up and eventually the game crashes - lowering the texture quality just gives you more time before this occurs.

I'd also like to share some logs:

vrserver.txt vrmonitor.txt vrcompositor.txt

The key line in the vrcompositor.txt file that I noticed was:

Sun Mar 29 2020 11:47:06.981780 - CVulkanVRRenderer::CreateTexture - Unable to allocate memory

rstrube avatar Mar 29 '20 19:03 rstrube

My logs are pretty much identical to yours @rstrube vrserver.txt vrmonitor.txt vrcompositor.txt

I wonder if it is related to this https://www.gitmemory.com/issue/doitsujin/dxvk/1100/508604155

ZarathustraDK avatar Mar 29 '20 20:03 ZarathustraDK

It doesn't really get progressively more choppy for me (Well I stopped progressing at chapter 3 waiting for a fix), it's more like it always get choppy at particular points whether or not you just loaded in prior to that point. The crashing-bug feels more like something in the game goes "Oh, I see you've loaded this much into vRAM, I'll let you play smoothly for now, but next level-transition I'll crash your HMD".

It doesn't really get choppy for me, at all. I only have issues when looking at activated upgrade stations or when looking at the weapon select menu, but only after a few mins in game. Other than that, my game manages to just barely maintain, or just barely drop below 90fps, regardless of the visual complexity of the scene.

llamasking avatar Mar 29 '20 20:03 llamasking

Loading crash unfortunately still occurs with the latest Steam VR (1.11.4).

I've also been able to monitor my VRAM usage during the game, and I noticed what appears to be very high memory pressure. Perhaps this is by design though and games should consume as much VRAM as possible? Not sure.

When using the nvidia-smi utility I witnessed 7959 out of 7979 MB consumed.

rstrube avatar Apr 01 '20 05:04 rstrube

Loading crash unfortunately still occurs with the Nvidia Beta 440.66.07 drivers :(

Performance is definitely better with these drivers though! So there is progress being made!

rstrube avatar Apr 02 '20 18:04 rstrube

Loading crash still occurs with the Nvidia Beta 440.66.08 drivers. Performance improvements are still there though! Overall I would say the game runs perfectly now, it's just the loading crashes that make it frustrating to play.

rstrube avatar Apr 03 '20 15:04 rstrube

Still having the loading transition crash with Steam VR Beta (1.11.5) and Proton 5.0-6 RC :(

rstrube avatar Apr 06 '20 16:04 rstrube

The latest HL:Alyx update (1.2.1) and SteamVR Beta (1.11.6) seem to have completely fixed all performance ~~and crashing issues~~.

I no longer experience the crash when loading levels and my performance actually changes depending on what I look at rather than being pinned at just about 90 fps.

Edit: Never mind on the crashing bit. The game did crash eventually. It just took a lot more play time than it used to before it did. It originally crashed after just a few seconds, but now it takes several minutes before a load crashed the game.

llamasking avatar Apr 09 '20 18:04 llamasking

Update: The game does still crash on loading screens. It just takes significantly longer than it used to. I can now go from the autosave before the crash in the original post, to the loading screen and not crash. Before, I had to jump into the loading screen in no more than a few seconds or I would crash.

llamasking avatar Apr 09 '20 19:04 llamasking

Game still reliably crashes on loading screens.

SteamVR 1.11.6 HL Alyx 1.2.1 Proton 5.0-5 [next] (also tried regular 5.0-5) Nvidia RTX 2080ti

Crashed at the Train at the end of chapter 1, and then again at the end of the first area of chapter 2. steam-546560.log vrcompositor.txt vrmonitor.txt vrserver.txt

Crash happens around 22:17 in the logs.

ZarathustraDK avatar Apr 09 '20 20:04 ZarathustraDK

Unfortunately I'm still experiencing the issue with crashing on the loading screens.

  • Steam VR Beta 1.11.7
  • HL Alyx 1.2.1
  • Proton 5.0-6 RC2
  • Nvidia RTX 2070 w/ driver 440.82

After the crash the game continues to run in the background (you can see it on the spectator view and hear the sounds). It seems like Steam VR has crashed (perhaps the compositor?), not necessarily the game.

Edit: I checked my kernel logs and found this:

[ 1115.972947] RenderThread[4392]: segfault at 8 ip 000000000058fd5d sp 00007f3778a01ed0 error 4 in vrcompositor[400000+36f000]
[ 1115.972953] Code: 01 00 00 00 0f 84 73 02 00 00 8b 80 10 01 00 00 48 8d 44 10 10 48 8b 44 c7 10 48 85 c0 48 89 85 40 ff ff ff 0f 84 6a 02 00 00 <41> 8b 47 08 83 f8 14 0f 87 76 02 00 00 48 8d 15 2f 2b 12 00 45 8b
[ 1118.054242] nvidia-modeset: ERROR: GPU:0: Idling display engine timed out: 0x0000c57e:0:0:982
[ 1120.050415] nvidia-modeset: ERROR: GPU:0: Idling display engine timed out: 0x0000c57e:0:0:982
[ 1122.046745] nvidia-modeset: ERROR: GPU:0: Idling display engine timed out: 0x0000c57e:0:0:982
[ 1124.043280] nvidia-modeset: ERROR: GPU:0: Idling display engine timed out: 0x0000c57e:0:0:982
[ 1971.349776] RenderThread[7934]: segfault at 8 ip 000000000058fd5d sp 00007f51f123aed0 error 4 in vrcompositor[400000+36f000]
[ 1971.349780] Code: 01 00 00 00 0f 84 73 02 00 00 8b 80 10 01 00 00 48 8d 44 10 10 48 8b 44 c7 10 48 85 c0 48 89 85 40 ff ff ff 0f 84 6a 02 00 00 <41> 8b 47 08 83 f8 14 0f 87 76 02 00 00 48 8d 15 2f 2b 12 00 45 8b

rstrube avatar Apr 10 '20 06:04 rstrube

Here are all my logs, hopefully this will help troubleshoot the issue:

  • Steam VR Beta 1.11.7
  • HL Alyx 1.2.1
  • Proton 5.0-6 RC3
  • Nvidia RTX 2070 w/ driver 440.82

vrserver.txt vrclient_vrstartup.txt vrclient_steam.txt vrclient_vrcompositor.txt vrclient_vrwebhelper_main.txt vrcompositor.txt vrmonitor.txt

rstrube avatar Apr 10 '20 20:04 rstrube

with both tickets still open here and https://github.com/ValveSoftware/Proton/issues/3681 I wonder where the better place is to report VR related (game specific) issues generally? or are they all followed equally anyway?

frostworx avatar Apr 18 '20 11:04 frostworx