ALVR icon indicating copy to clipboard operation
ALVR copied to clipboard

AV1 Codec support

Open gareth-anthony-hulse opened this issue 1 year ago • 29 comments

Would like to have the AV1 codec as an option for those of use who can't achieve a decent bit rate. I am using the D-Link DWA-X1850 with the rtl8852au Linux kernel driver, as an access point using the 802.11ac standard. Current setup can achieve ~16Mbps average at best, sometimes with sudden dips into single digits. Using HEVC makes it tolerable, but the blurriness is definitely noticeable when looking at objects from a distance or down iron sights without fibre optics.

Hardware: https://linux-hardware.org/?probe=382901fcd7

gareth-anthony-hulse avatar Mar 11 '23 04:03 gareth-anthony-hulse

That would have to be done with software decoding the quest or really the XR2 is simply not powerful enough to make this a good experience. Anyway my guess is that you have ALVR mis-configured.

Vixea avatar Mar 11 '23 04:03 Vixea

@Vixea My ALVR config: session.zip

gareth-anthony-hulse avatar Mar 11 '23 05:03 gareth-anthony-hulse

could you also give me a screenshot of the video tab in settings mostly interested in the area that says bitrate

Vixea avatar Mar 11 '23 05:03 Vixea

anyway try changing the foveated encoding ratio to 2 and 3(top one 2, bottom one 3

Vixea avatar Mar 11 '23 05:03 Vixea

This what is looks like at the moment: Screenshot_20230311_051558

I'll try editing the foveated encoding.

gareth-anthony-hulse avatar Mar 11 '23 05:03 gareth-anthony-hulse

how did you come up with the number 6 could you try 8 and see if that increases it?

Vixea avatar Mar 11 '23 05:03 Vixea

Changed 'networkLaytencyMs' to 8, Horizontal compression ratio to 2 and vertical compression radio to 3. Ran Blade & Sorcery for couple of minutes and here are the results: Screenshot_20230311_055013

gareth-anthony-hulse avatar Mar 11 '23 05:03 gareth-anthony-hulse

try changing it saturation instead

Vixea avatar Mar 11 '23 06:03 Vixea

Using 'adaptiveWithSaturation' with saturation multiplier of 0.95, while playing H3VR (Blade & Sorcery was getting stuck at 84% for some reason): Screenshot_20230311_063328

gareth-anthony-hulse avatar Mar 11 '23 06:03 gareth-anthony-hulse

Oh and I am using ALVR version v20.0.0-dev07+nightly.2023.03.09, with SteamVR 1.25.5.

gareth-anthony-hulse avatar Mar 11 '23 06:03 gareth-anthony-hulse

have you tried restarting your router :D

Vixea avatar Mar 11 '23 06:03 Vixea

also for the blurriness did you not set the resolution to be 100%?

Vixea avatar Mar 11 '23 06:03 Vixea

The Quest 2 isn't directly connected to the ASUS GT-AX11000 router, but I'll give it a try. The headset is connected to the D-Link DWA-X1850, which is setup as a WiFi 5 access point that is plugged into the PC via a USB 3.0 socket and the PC is connected to the router via WiFi 6. Also, yes the resolution is set to 100%.

gareth-anthony-hulse avatar Mar 11 '23 07:03 gareth-anthony-hulse

hmm, wifi hotspot support isn't exactly the best in windows could you try the router instead?

Vixea avatar Mar 11 '23 07:03 Vixea

I am using Linux - see hardware link in first post. Haven't tried the router for a while because the latency was constantly high. I'll give it another go.

gareth-anthony-hulse avatar Mar 11 '23 07:03 gareth-anthony-hulse

Result when using the ASUS GT-AX11000 router in H3VR - take note of the Mbps and client FPS: Screenshot_20230311_074001

gareth-anthony-hulse avatar Mar 11 '23 07:03 gareth-anthony-hulse

Back on the subject of the AV1 codec, while the current gen VR headsets don't support it very well, future generations hopefully will.

gareth-anthony-hulse avatar Mar 11 '23 07:03 gareth-anthony-hulse

and I'm sure we'll add it when its ready as right now this is a won't fix

Vixea avatar Mar 11 '23 12:03 Vixea

Now that the Quest 3 is out and supports AV1, with Meta defaulting to AV1 for Air Link as far as I understand, I guess this could be reopened?

wsippel avatar Oct 13 '23 10:10 wsippel

Please reopen this. AV1 is a game changer on Q3 based on what VD users report.

phobos2077 avatar Dec 08 '23 10:12 phobos2077

I will work on AV1 support for Windows/Nvidia soon.

zmerp avatar Dec 09 '23 12:12 zmerp

Very nice! I already have patches to enable AV1 encoding on Linux using VA-API, I just couldn't figure out how to decode the stream on the client. So Linux support could follow quickly once the Windows patches land.

wsippel avatar Dec 10 '23 10:12 wsippel

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Mar 08 '24 00:03 github-actions[bot]

Plz reopen, AV1 is still not supported on Windows.

phobos2077 avatar Mar 08 '24 18:03 phobos2077

It is in fact partially supported on windows (you need to have an AMD GPU), we know Nvidia on windows doesn't support it, it's not critical, and it was going to be closed soon anyway by the bot so. No

Vixea avatar Mar 08 '24 19:03 Vixea

@Vixea It's not supported on Windows/Nvidia, it's a real issue.

zmerp avatar Mar 08 '24 19:03 zmerp

You need to be sleeping :P

Vixea avatar Mar 08 '24 20:03 Vixea

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

I believe Windows/NVidia is still not implemented.

phobos2077 avatar May 11 '24 08:05 phobos2077