amazon-linux-2023 icon indicating copy to clipboard operation
amazon-linux-2023 copied to clipboard

[Package Request] - NVIDIA GPUDirect Storage driver

Open bryantbiggs opened this issue 9 months ago • 1 comments

What package is missing from Amazon Linux 2023? Please describe and include package name.

  • NVIDIA GPUDirect Storage driver

:warning: Note - requires kernel version of 6.8+

Is this an update to existing package or new package request?

  • New

Is this package available in Amazon Linux 2? If it is available via external sources such as EPEL, please specify.

  • Not that I am aware

Any additional information you'd like to include. (use-cases, etc)

  • Current install steps in the EFA docs are building from source: https://docs.aws.amazon.com/fsx/latest/LustreGuide/configure-efa-clients.html#install-gds-on-client
  • NVIDIA docs for installation steps: https://docs.nvidia.com/gpudirect-storage/troubleshooting-guide/index.html#installing-gpudirect-storage
  • This is to support services that build and provide AL based AMIs to customers such as https://github.com/awslabs/amazon-eks-ami/issues/2181

bryantbiggs avatar Mar 25 '25 13:03 bryantbiggs

If you install your NVIDIA driver from NVIDIA repository or Amazon Linux nvidia-release, gds is available.

To add AL2023 NVIDIA repository

sudo dnf install -y nvidia-release

To verify

[ec2-user@ip-172-31-41-46 ~]$ sudo dnf info nvidia-gds
Amazon Linux 2023 NVIDIA repository                                                                                                              3.5 MB/s | 496 kB     00:00    
Available Packages
Name         : nvidia-gds
Version      : 12.8.0
Release      : 1
Architecture : x86_64
Size         : 7.3 k
Source       : nvidia-gds-12.8.0-1.src.rpm
Repository   : amazonlinux-nvidia
Summary      : GPU Direct Storage meta-package
URL          : http://nvidia.com
License      : NVIDIA Proprietary
Description  : Meta-package for GPU Direct Storage containing all the available packages required for libcufile and nvidia-fs.

To install

sudo dnf install -y nvidia-gds

Can confirm that it works with 2023.7.20250527

[ec2-user@ip-172-31-3-125 ~]$ lsmod | grep nvidia_fs
nvidia_fs             266240  0
nvidia              11653120  3 nvidia_uvm,nvidia_fs,nvidia_modeset
[ec2-user@ip-172-31-3-125 ~]$ dnf info nvidia-fs
Last metadata expiration check: 0:12:36 ago on Tue Jun  3 02:29:05 2025.
Installed Packages
Name         : nvidia-fs
Version      : 2.25.6
Release      : 1
Architecture : x86_64
Size         : 0.0  
Source       : nvidia-fs-2.25.6-1.src.rpm
Repository   : @System
From repo    : amazonlinux-nvidia
Summary      : NVIDIA filesystem for GPUDirect Storage
URL          : http://nvidia.com
License      : NVIDIA Proprietary
Description  : Metapackage for NVIDIA filesystem driver that is part of GPUDirect Storage (GDS)

[ec2-user@ip-172-31-3-125 ~]$ rpm -q system-release
system-release-2023.7.20250527-0.amzn2023.noarch

limmike avatar May 22 '25 12:05 limmike