nvidia-vaapi-driver
nvidia-vaapi-driver copied to clipboard
elFarto
vaapi version mismatch and driver errors
System Info: Firefox version: 100.0 (64-bit) Ubuntu 22.04 15.05 kernel RTX 3080 Nvidia Driver: 510.60.02 nvidia_drm.modeset=1 set env:
MOZ_DISABLE_RDD_SANDBOX=1
MOZ_X11_EGL=1
LIBVA_DRIVER_NAME=nvidia
I've got some issues getting firefox (and other applications) to recognize the vaapi nvidia drivers correctly. I initially had some trouble removing VDPAU and installing NVDEC but vainfo is now reporting NVDEC is installed correctly:
NVD_LOG=1 vainfo
libva info: VA-API version 1.14.0
libva info: User environment variable requested driver 'nvidia'
libva info: Trying to open /usr/local/lib/dri/nvidia_drv_video.so
libva info: Found init function __vaDriverInit_1_0
[68770-68770] ../src/vabackend.c:1642 __vaDriverInit_1_0 Initialising NVIDIA VA-API Driver: 0x563151f88e50 10
[68770-68770] ../src/vabackend.c:1645 __vaDriverInit_1_0 Non-DRM display type detected, defaulting to GPU ID 0. Use NVD_GPU to pick a specific GPU.
[68770-68770] ../src/export-buf.c: 164 findGPUIndexFromFd Looking for GPU index: 0
[68770-68770] ../src/export-buf.c: 175 findGPUIndexFromFd Found 3 EGL devices
[68770-68770] ../src/export-buf.c: 184 findGPUIndexFromFd Got EGL_CUDA_DEVICE_NV value '0' for EGLDevice 0
[68770-68770] ../src/export-buf.c: 136 checkModesetParameterFromFd Unable to check nvidia_drm modeset setting
[68770-68770] ../src/export-buf.c: 208 findGPUIndexFromFd Selecting EGLDevice 0
[68770-68770] ../src/export-buf.c: 270 initExporter Driver doesn't support 16-bit surfaces
[68770-68770] ../src/export-buf.c: 103 reconnect Reconnecting to stream
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.14 (libva 2.12.0)
vainfo: Driver version: VA-API NVDEC driver
vainfo: Supported profile and entrypoints
VAProfileMPEG2Simple : VAEntrypointVLD
VAProfileMPEG2Main : VAEntrypointVLD
VAProfileVC1Simple : VAEntrypointVLD
VAProfileVC1Main : VAEntrypointVLD
VAProfileVC1Advanced : VAEntrypointVLD
<unknown profile> : VAEntrypointVLD
VAProfileH264Main : VAEntrypointVLD
VAProfileH264High : VAEntrypointVLD
VAProfileH264ConstrainedBaseline: VAEntrypointVLD
VAProfileHEVCMain : VAEntrypointVLD
VAProfileVP8Version0_3 : VAEntrypointVLD
VAProfileVP9Profile0 : VAEntrypointVLD
VAProfileAV1Profile0 : VAEntrypointVLD
[68770-68770] ../src/vabackend.c:1626 nvTerminate Terminating 0x563151f88e50
[68770-68770] ../src/export-buf.c: 65 releaseExporter Releasing exporter, 0 outstanding frames
[68770-68770] ../src/export-buf.c: 82 releaseExporter Done releasing frames
firefox (vaapi 1.7.0) errors
Gtk-Message: 11:39:27.937: Failed to load module "canberra-gtk-module"
Gtk-Message: 11:39:27.938: Failed to load module "canberra-gtk-module"
ATTENTION: default value of option mesa_glthread overridden by environment.
ATTENTION: default value of option mesa_glthread overridden by environment.
libva info: VA-API version 1.7.0
libva info: User environment variable requested driver 'nvidia'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/nvidia_drv_video.so
libva info: va_openDriver() returns -1
VLC at least reports the same newer vaapi version but still returns errors. I have tested various H264/HEVC files with the same results. Videos usually play with poor performance and fall back to software decoding. GPU utilization remains low.
vlc (vaapi 1.14.0) errors
[00007fda04004910] gl gl: Initialized libplacebo v4.192.1 (API v192)
libva info: VA-API version 1.14.0
libva info: User environment variable requested driver 'nvidia'
libva info: Trying to open /usr/local/lib/dri/nvidia_drv_video.so
libva info: Found init function __vaDriverInit_1_0
libva info: va_openDriver() returns 0
[00007fda04004910] glconv_vaapi_x11 gl error: vaDeriveImage: operation failed
[00007fda006e7320] main video output error: video output creation failed
[00007fda18cc9c50] main decoder error: failed to create video output
[00007fda04099d90] gl gl: Initialized libplacebo v4.192.1 (API v192)
[00007fda04099d90] gl gl: Initialized libplacebo v4.192.1 (API v192)
I think hardware decoding is working with mpv player. I notice the "compute" type showing up in nvtop and cpu usage is fairly low for that process compared to when I use another video player. For a few videos I only see a green screen with audio, but I think that's an unrelated issue. I'm not exactly sure where to go from here.
It's unlikely to work under vlc, as that's not something I've been testing with. The green output with mpv is related to not having the latest git version of it, which has the fix for that issue.
Can you run Firefox with the following environment variables set: NVD_LOG=1 MOZ_LOG="Dmabuf:5, PlatformDecoderModule:5" and post the output?
Ok I'm not too worried about the VLC thing I just noticed a bunch of errors after switching from VDPAU and thought they might provide a troubleshooting clue. I wanted to make sure I could actually get it working somewhere before I tackled all of the firefox stuff.
Here is the beginning bit I think is probably most relevant
Gtk-Message: 14:35:44.229: Failed to load module "xapp-gtk3-module"
Gtk-Message: 14:35:44.258: Failed to load module "canberra-gtk-module"
Gtk-Message: 14:35:44.259: Failed to load module "canberra-gtk-module"
[Parent 12939: Main Thread]: D/Dmabuf Using DRM device /dev/dri/renderD128
[Parent 12939: Main Thread]: D/Dmabuf nsDMABufDevice::Configure()
[Parent 12939: Main Thread]: D/Dmabuf Loading DMABuf system library libgbm.so.1 ...
ATTENTION: default value of option mesa_glthread overridden by environment.
ATTENTION: default value of option mesa_glthread overridden by environment.
[Parent 12939: Main Thread]: D/Dmabuf DMABuf is enabled
[Parent 12939: Main Thread]: D/Dmabuf VAAPIGetAcceleratedProfiles()
libva info: VA-API version 1.7.0
libva info: User environment variable requested driver 'nvidia'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/nvidia_drv_video.so
libva info: va_openDriver() returns -1
[Parent 12939: Main Thread]: D/Dmabuf Failed to initialise VAAPI connection: unknown libva error.
[Child 13502: Main Thread]: D/PlatformDecoderModule PDMInitializer, Init PDMs in Content process
[Child 13502: Main Thread]: D/Dmabuf Using DRM device /dev/dri/renderD128
[Child 13502: Main Thread]: D/Dmabuf Failed to open drm render node /dev/dri/renderD128 error Permission denied
[Child 13502: Main Thread]: D/Dmabuf nsDMABufDevice::IsDMABufVAAPIEnabled: EGL 1 media_ffmpeg_vaapi_enabled 1 CanUseHardwareVideoDecoding 1 XRE_IsRDDProcess 0
[Child 13502: Main Thread]: D/Dmabuf nsDMABufDevice::IsDMABufVAAPIEnabled: EGL 1 media_ffmpeg_vaapi_enabled 1 CanUseHardwareVideoDecoding 1 XRE_IsRDDProcess 0
Here is the full log where I open a firefox window, navigate to youtube, and start playing a video.
Ok, something is very wrong here. Something like this should be logged directly after libva info: Trying to open...:
14637.849173988 [59438-59438] ../src/vabackend.c:1775 __vaDriverInit_1_0 Initialising NVIDIA VA-API Driver: 0x7fefbdc1e980 31
Can you run: ls -l /usr/lib/x86_64-linux-gnu/dri/?
Also of concern is this Failed to open drm render node /dev/dri/renderD128 error Permission denied. Can you try running NVD_LOG=1 vainfo --display drm?
ls -l /usr/lib/x86_64-linux-gnu/dri/
total 436652
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 crocus_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 d3d12_dri.so
-rw-r--r-- 6 root root 17133096 Mar 16 04:07 i830_dri.so
-rw-r--r-- 6 root root 17133096 Mar 16 04:07 i915_dri.so
-rw-r--r-- 6 root root 17133096 Mar 16 04:07 i965_dri.so
-rw-r--r-- 1 root root 1764040 Jul 11 2020 i965_drv_video.so
-rw-r--r-- 1 root root 8004216 Apr 4 16:23 iHD_drv_video.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 iris_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 kms_swrast_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 nouveau_dri.so
-rw-r--r-- 3 root root 11206848 Apr 14 05:28 nouveau_drv_video.so
-rw-r--r-- 6 root root 17133096 Mar 16 04:07 nouveau_vieux_dri.so
-rwxr-xr-x 1 root root 498032 May 10 12:09 nvdec_drv_video.so
-rwxr-xr-x 1 root root 497584 May 10 12:15 nvidia_drv_video.so
-rw-r--r-- 6 root root 17133096 Mar 16 04:07 r200_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 r300_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 r600_dri.so
-rw-r--r-- 3 root root 11206848 Apr 14 05:28 r600_drv_video.so
-rw-r--r-- 6 root root 17133096 Mar 16 04:07 radeon_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 radeonsi_dri.so
-rw-r--r-- 3 root root 11206848 Apr 14 05:28 radeonsi_drv_video.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 swrast_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 virtio_gpu_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 vmwgfx_dri.so
-rw-r--r-- 12 root root 24990520 Apr 14 05:28 zink_dri.so
NVD_LOG=1 vainfo --display drm
libva info: VA-API version 1.14.0
libva info: User environment variable requested driver 'nvidia'
libva info: Trying to open /usr/local/lib/dri/nvidia_drv_video.so
libva info: Found init function __vaDriverInit_1_0
[19838-19838] ../src/vabackend.c:1642 __vaDriverInit_1_0 Initialising NVIDIA VA-API Driver: 0x5612e6105440 31
[19838-19838] ../src/export-buf.c: 162 findGPUIndexFromFd Looking for drmDeviceIndex: 0
[19838-19838] ../src/export-buf.c: 175 findGPUIndexFromFd Found 3 EGL devices
[19838-19838] ../src/export-buf.c: 184 findGPUIndexFromFd Got EGL_CUDA_DEVICE_NV value '0' for EGLDevice 0
[19838-19838] ../src/export-buf.c: 190 findGPUIndexFromFd Found drmDeviceIndex: 0
[19838-19838] ../src/export-buf.c: 208 findGPUIndexFromFd Selecting EGLDevice 0
[19838-19838] ../src/export-buf.c: 270 initExporter Driver doesn't support 16-bit surfaces
[19838-19838] ../src/export-buf.c: 103 reconnect Reconnecting to stream
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.14 (libva 2.12.0)
vainfo: Driver version: VA-API NVDEC driver
vainfo: Supported profile and entrypoints
VAProfileMPEG2Simple : VAEntrypointVLD
VAProfileMPEG2Main : VAEntrypointVLD
VAProfileVC1Simple : VAEntrypointVLD
VAProfileVC1Main : VAEntrypointVLD
VAProfileVC1Advanced : VAEntrypointVLD
<unknown profile> : VAEntrypointVLD
VAProfileH264Main : VAEntrypointVLD
VAProfileH264High : VAEntrypointVLD
VAProfileH264ConstrainedBaseline: VAEntrypointVLD
VAProfileHEVCMain : VAEntrypointVLD
VAProfileVP8Version0_3 : VAEntrypointVLD
VAProfileVP9Profile0 : VAEntrypointVLD
VAProfileAV1Profile0 : VAEntrypointVLD
[19838-19838] ../src/vabackend.c:1626 nvTerminate Terminating 0x5612e6105440
[19838-19838] ../src/export-buf.c: 65 releaseExporter Releasing exporter, 0 outstanding frames
[19838-19838] ../src/export-buf.c: 82 releaseExporter Done releasing frames
Ok, I think I see the problem, or at least part of the problem. vainfo is looking in /usr/local/lib/dri/ and Firefox is looking in /usr/lib/x86_64-linux-gnu/dri/. Did you build libva yourself? If so you'll want to remove the old install in /usr/local and rebuild it with --prefix=/usr. You'll also want to double check that it installs the lib into /usr/lib/x86_64-linux-gnu/libva.so.*, Ubuntu/Debian use multi-arch lib directories which may not be automatically detected when you build from source.
I installed a handful of packages from apt including libva2, libva-dev, libva-x11-2, libva-drm2 and it installed them to /usr/lib/x86_64-linux-gnu/ however initially I was following this guide: https://github.com/marioroy/nvidia-acceleration-on-ubuntu and it looks like it builds libva manually. I can remove the /usr/local/lib/dri libva but I'm not sure how to tell libva to use the correct /usr/lib/x86...etc one.
/usr/local is hardcoded in libva at compile time in the scripts/100-build-libva script. It looks like those instructions also want you to set LIBVA_DRIVERS_PATH=/usr/local/lib/dri which would override where libva looks for the drivers.
Those instructions seem fine, but they've very opinionated, and make some different choices, like installing this driver as nvdec_drv_video.so, rather than nvidia_drv_video.so. So it's better to follow those instructions, or ignore them completely, trying to mix and match will likely bite you in the ass.
Firefox is at 101.0.1 on Ubuntu 20.04 and the reason not experiencing issues mentioned above. So I installed Ubuntu 22.04 to an external drive.
Sadly, Firefox is a snap package (or container) in Ubuntu 21.10 and 22.04. The {nvdec, vdpau, or nvidia}_drv_video.so does not exist inside the snap container. No matter if installing/copying the lib file to /usr/lib/x86_64-linux-gnu/dri/ or /usr/local/lib/dri/.
I tried a DEB package from Mozilla, instructions here. Unfortunately, Firefox 102 introduced a bug preventing the NVDEC VA-API driver from working. Another solution is Ubuntuzilla providing Firefox 101.0.1. The NVDEC driver works great.
Not able to use one solution, I named the two VA-API drivers uniquely in my repo so that they can co-exist. The NVDEC driver works great in Firefox whereas the VDPAU driver works great in Google Chrome, Brave, Opera, and Vivaldi.
Ubuntuzilla updated Firefox to 102.0. I removed the package including the apt source entry and trusted key from apt. The following instructions was tested on Ubuntu 22.04.
Remove Firefox snap package.
sudo snap remove --purge firefox
The NVDEC VA-API driver does not work in Firefox 102.0. Obtain and install Firefox 101.0.1 and dependencies.
cd ~/Downloads
wget http://http.us.debian.org/debian/pool/main/f/firefox/firefox_101.0.1-1_amd64.deb
wget http://http.us.debian.org/debian/pool/main/n/nss/libnss3_3.79-1_amd64.deb
wget http://http.us.debian.org/debian/pool/main/n/nspr/libnspr4_4.34-1_amd64.deb
sudo apt install ./firefox_101.0.1-1_amd64.deb ./libnss3_3.79-1_amd64.deb ./libnspr4_4.34-1_amd64.deb
Prevent Firefox from updating.
sudo apt-mark hold firefox
dpkg --get-selections firefox
Once HW acceleration is working again (hoping Firefox 103), one can remove the hold and follow the instructions for installing new build.
sudo apt-mark unhold firefox
dpkg --get-selections firefox
The nvidia-acceleration-on-ubuntu repo works on Ubuntu 22.04 (running X11 with NVIDIA proprietary driver). Firefox and Chromium-based browsers utilize the video engine while playing a video.
I updated the guide at https://github.com/marioroy/nvidia-acceleration-on-ubuntu to install Firefox as a .deb package on Ubuntu 21.10 and 22.04. Hardware acceleration is sadly broken in Firefox 102 using NVIDIA graphics. So, I extended the Epilogue section on how to obtain the latest beta. The ~/bin/run-firefox script now defaults to ~/firefox/firefox otherwise /usr/bin/firefox.
I purchased a RTX 3070 from eBay when the price dropped. Setting media.ffvpx.enabled to false caused AV1 decode acceleration to not work on Ubuntu. I reverted the change for my Ubuntu repo. AV1 acceleration works great.
media.ffvpx.enabled true
media.av1.enabled true
Ubuntu updates has landed Firefox 103.0 for Ubuntu 20.04 and 22.04. Hardware acceleration is working again. Be sure to set media.ffmpeg.vaapi.enabled to true via about:config. Optionally, set media.av1.enabled to false if AV1 is not supported by your graphics card.
Closing issue as it seems to be caused by old/mismatched libva versions/builds.