nvidia-docker icon indicating copy to clipboard operation
nvidia-docker copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

Tensorflow is taking a much longer time to run on GPU than CPU

Open jedichen121 opened this issue 2 years ago • 0 comments

1. Issue or feature description

When using nvidia-docker and running tensorflow-gpu, some simple operation is taking a really long time to finish. A command takes 3s on CPU would take 8 mins on 3060Ti GPU. Any help is appreciated. Thank you.

2. Steps to reproduce the issue

docker run -it --name rvms --gpus all -v /home/chenjiyang/rvms/:/rvms nvcr.io/nvidia/tensorflow:20.03-tf2-py3

Because tensorflow-gpu 2.1 is not compatible with cuda 10.2. I followed the instructions here to add some soft links and solve the problem.

time python -c "import tensorflow as tf;print(tf.reduce_sum(tf.random.normal([1000, 1000])))"

This command takes 8 mins to finish.

3. Information to attach (optional if deemed irrelevant)

  • [x] Some nvidia-container information: nvidia-container-cli -k -d /dev/tty info

-- WARNING, the following logs are for debugging purposes only --

I0322 14:35:24.409601 13841 nvc.c:376] initializing library context (version=1.9.0, build=5e135c17d6dbae861ec343e9a8d3a0d2af758a4f) I0322 14:35:24.409634 13841 nvc.c:350] using root / I0322 14:35:24.409636 13841 nvc.c:351] using ldcache /etc/ld.so.cache I0322 14:35:24.409639 13841 nvc.c:352] using unprivileged user 1000:1000 I0322 14:35:24.409660 13841 nvc.c:393] attempting to load dxcore to see if we are running under Windows Subsystem for Linux (WSL) I0322 14:35:24.409746 13841 nvc.c:395] dxcore initialization failed, continuing assuming a non-WSL environment W0322 14:35:24.410493 13842 nvc.c:273] failed to set inheritable capabilities W0322 14:35:24.410512 13842 nvc.c:274] skipping kernel modules load due to failure I0322 14:35:24.410666 13843 rpc.c:71] starting driver rpc service I0322 14:35:24.412386 13844 rpc.c:71] starting nvcgo rpc service I0322 14:35:24.412916 13841 nvc_info.c:765] requesting driver information with '' I0322 14:35:24.414030 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/vdpau/libvdpau_nvidia.so.470.103.01 I0322 14:35:24.414152 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvoptix.so.470.103.01 I0322 14:35:24.414188 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-tls.so.470.103.01 I0322 14:35:24.414212 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-rtcore.so.470.103.01 I0322 14:35:24.414240 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.470.103.01 I0322 14:35:24.414267 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.470.103.01 I0322 14:35:24.414293 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.470.103.01 I0322 14:35:24.414313 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ngx.so.470.103.01 I0322 14:35:24.414335 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.470.103.01 I0322 14:35:24.414373 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ifr.so.470.103.01 I0322 14:35:24.414410 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.470.103.01 I0322 14:35:24.414429 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.470.103.01 I0322 14:35:24.414445 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.470.103.01 I0322 14:35:24.414462 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-fbc.so.470.103.01 I0322 14:35:24.414486 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-encode.so.470.103.01 I0322 14:35:24.414511 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.470.103.01 I0322 14:35:24.414528 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.470.103.01 I0322 14:35:24.414547 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.470.103.01 I0322 14:35:24.414573 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-cbl.so.470.103.01 I0322 14:35:24.414592 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.470.103.01 I0322 14:35:24.414619 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvcuvid.so.470.103.01 I0322 14:35:24.414779 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libcuda.so.470.103.01 I0322 14:35:24.414869 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libGLX_nvidia.so.470.103.01 I0322 14:35:24.414889 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libGLESv2_nvidia.so.470.103.01 I0322 14:35:24.414909 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libGLESv1_CM_nvidia.so.470.103.01 I0322 14:35:24.414931 13841 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.470.103.01 I0322 14:35:24.414978 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/vdpau/libvdpau_nvidia.so.470.103.01 I0322 14:35:24.415033 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-tls.so.470.103.01 I0322 14:35:24.415064 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-ptxjitcompiler.so.470.103.01 I0322 14:35:24.415096 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-opticalflow.so.470.103.01 I0322 14:35:24.415122 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-opencl.so.470.103.01 I0322 14:35:24.415141 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-ml.so.470.103.01 I0322 14:35:24.415168 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-ifr.so.470.103.01 I0322 14:35:24.415192 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-glvkspirv.so.470.103.01 I0322 14:35:24.415210 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-glsi.so.470.103.01 I0322 14:35:24.415226 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-glcore.so.470.103.01 I0322 14:35:24.415243 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-fbc.so.470.103.01 I0322 14:35:24.415268 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-encode.so.470.103.01 I0322 14:35:24.415291 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-eglcore.so.470.103.01 I0322 14:35:24.415309 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-compiler.so.470.103.01 I0322 14:35:24.415326 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-allocator.so.470.103.01 I0322 14:35:24.415352 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvcuvid.so.470.103.01 I0322 14:35:24.415399 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libcuda.so.470.103.01 I0322 14:35:24.415436 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libGLX_nvidia.so.470.103.01 I0322 14:35:24.415463 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libGLESv2_nvidia.so.470.103.01 I0322 14:35:24.415488 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libGLESv1_CM_nvidia.so.470.103.01 I0322 14:35:24.415518 13841 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libEGL_nvidia.so.470.103.01 W0322 14:35:24.415542 13841 nvc_info.c:398] missing library libnvidia-nscq.so W0322 14:35:24.415548 13841 nvc_info.c:398] missing library libnvidia-fatbinaryloader.so W0322 14:35:24.415553 13841 nvc_info.c:398] missing library libnvidia-pkcs11.so W0322 14:35:24.415560 13841 nvc_info.c:402] missing compat32 library libnvidia-cfg.so W0322 14:35:24.415566 13841 nvc_info.c:402] missing compat32 library libnvidia-nscq.so W0322 14:35:24.415572 13841 nvc_info.c:402] missing compat32 library libnvidia-fatbinaryloader.so W0322 14:35:24.415576 13841 nvc_info.c:402] missing compat32 library libnvidia-pkcs11.so W0322 14:35:24.415581 13841 nvc_info.c:402] missing compat32 library libnvidia-ngx.so W0322 14:35:24.415586 13841 nvc_info.c:402] missing compat32 library libnvidia-rtcore.so W0322 14:35:24.415591 13841 nvc_info.c:402] missing compat32 library libnvoptix.so W0322 14:35:24.415596 13841 nvc_info.c:402] missing compat32 library libnvidia-cbl.so I0322 14:35:24.416099 13841 nvc_info.c:298] selecting /usr/bin/nvidia-smi I0322 14:35:24.416125 13841 nvc_info.c:298] selecting /usr/bin/nvidia-debugdump I0322 14:35:24.416136 13841 nvc_info.c:298] selecting /usr/bin/nvidia-persistenced I0322 14:35:24.416152 13841 nvc_info.c:298] selecting /usr/bin/nvidia-cuda-mps-control I0322 14:35:24.416166 13841 nvc_info.c:298] selecting /usr/bin/nvidia-cuda-mps-server W0322 14:35:24.416202 13841 nvc_info.c:424] missing binary nv-fabricmanager I0322 14:35:24.416216 13841 nvc_info.c:342] listing firmware path /lib/firmware/nvidia/470.103.01/gsp.bin I0322 14:35:24.416233 13841 nvc_info.c:528] listing device /dev/nvidiactl I0322 14:35:24.416237 13841 nvc_info.c:528] listing device /dev/nvidia-uvm I0322 14:35:24.416239 13841 nvc_info.c:528] listing device /dev/nvidia-uvm-tools I0322 14:35:24.416244 13841 nvc_info.c:528] listing device /dev/nvidia-modeset I0322 14:35:24.416262 13841 nvc_info.c:342] listing ipc path /run/nvidia-persistenced/socket W0322 14:35:24.416273 13841 nvc_info.c:348] missing ipc path /var/run/nvidia-fabricmanager/socket W0322 14:35:24.416280 13841 nvc_info.c:348] missing ipc path /tmp/nvidia-mps I0322 14:35:24.416283 13841 nvc_info.c:821] requesting device information with '' I0322 14:35:24.422136 13841 nvc_info.c:712] listing device /dev/nvidia0 (GPU-24280536-bac0-f86c-3f64-d445498d60a8 at 00000000:01:00.0) NVRM version: 470.103.01 CUDA version: 11.4

Device Index: 0 Device Minor: 0 Model: NVIDIA GeForce RTX 3060 Ti Brand: GeForce GPU UUID: GPU-24280536-bac0-f86c-3f64-d445498d60a8 Bus Location: 00000000:01:00.0 Architecture: 8.6 I0322 14:35:24.422165 13841 nvc.c:430] shutting down library context I0322 14:35:24.422232 13844 rpc.c:95] terminating nvcgo rpc service I0322 14:35:24.422608 13841 rpc.c:135] nvcgo rpc service terminated successfully I0322 14:35:24.423056 13843 rpc.c:95] terminating driver rpc service I0322 14:35:24.423192 13841 rpc.c:135] driver rpc service terminated successfully

  • [x] Kernel version from uname -a

Linux victus 5.4.0-104-generic #118~18.04.1-Ubuntu SMP Thu Mar 3 13:53:15 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

  • [x] Driver information from nvidia-smi -a

==============NVSMI LOG==============

Timestamp : Tue Mar 22 15:35:59 2022 Driver Version : 470.103.01 CUDA Version : 11.4

Attached GPUs : 1 GPU 00000000:01:00.0 Product Name : NVIDIA GeForce RTX 3060 Ti Product Brand : GeForce Display Mode : Enabled Display Active : Enabled Persistence Mode : Disabled MIG Mode Current : N/A Pending : N/A Accounting Mode : Disabled Accounting Mode Buffer Size : 4000 Driver Model Current : N/A Pending : N/A Serial Number : N/A GPU UUID : GPU-24280536-bac0-f86c-3f64-d445498d60a8 Minor Number : 0 VBIOS Version : 94.04.6B.00.F5 MultiGPU Board : No Board ID : 0x100 GPU Part Number : N/A Module ID : 0 Inforom Version Image Version : G001.0000.03.03 OEM Object : 2.0 ECC Object : N/A Power Management Object : N/A GPU Operation Mode Current : N/A Pending : N/A GSP Firmware Version : N/A GPU Virtualization Mode Virtualization Mode : None Host VGPU Mode : N/A IBMNPU Relaxed Ordering Mode : N/A PCI Bus : 0x01 Device : 0x00 Domain : 0x0000 Device Id : 0x248910DE Bus Id : 00000000:01:00.0 Sub System Id : 0x88D4103C GPU Link Info PCIe Generation Max : 3 Current : 3 Link Width Max : 16x Current : 16x Bridge Chip Type : N/A Firmware : N/A Replays Since Reset : 0 Replay Number Rollovers : 0 Tx Throughput : 30000 KB/s Rx Throughput : 44000 KB/s Fan Speed : 30 % Performance State : P2 Clocks Throttle Reasons Idle : Not Active Applications Clocks Setting : Not Active SW Power Cap : Not Active HW Slowdown : Not Active HW Thermal Slowdown : Not Active HW Power Brake Slowdown : Not Active Sync Boost : Not Active SW Thermal Slowdown : Not Active Display Clock Setting : Not Active FB Memory Usage Total : 7959 MiB Used : 7700 MiB Free : 259 MiB BAR1 Memory Usage Total : 8192 MiB Used : 62 MiB Free : 8130 MiB Compute Mode : Default Utilization Gpu : 9 % Memory : 2 % Encoder : 0 % Decoder : 0 % Encoder Stats Active Sessions : 0 Average FPS : 0 Average Latency : 0 FBC Stats Active Sessions : 0 Average FPS : 0 Average Latency : 0 Ecc Mode Current : N/A Pending : N/A ECC Errors Volatile SRAM Correctable : N/A SRAM Uncorrectable : N/A DRAM Correctable : N/A DRAM Uncorrectable : N/A Aggregate SRAM Correctable : N/A SRAM Uncorrectable : N/A DRAM Correctable : N/A DRAM Uncorrectable : N/A Retired Pages Single Bit ECC : N/A Double Bit ECC : N/A Pending Page Blacklist : N/A Remapped Rows : N/A Temperature GPU Current Temp : 43 C GPU Shutdown Temp : 98 C GPU Slowdown Temp : 95 C GPU Max Operating Temp : 93 C GPU Target Temperature : 83 C Memory Current Temp : N/A Memory Max Operating Temp : N/A Power Readings Power Management : Supported Power Draw : 40.21 W Power Limit : 200.00 W Default Power Limit : 200.00 W Enforced Power Limit : 200.00 W Min Power Limit : 100.00 W Max Power Limit : 200.00 W Clocks Graphics : 1665 MHz SM : 1665 MHz Memory : 6800 MHz Video : 1455 MHz Applications Clocks Graphics : N/A Memory : N/A Default Applications Clocks Graphics : N/A Memory : N/A Max Clocks Graphics : 2100 MHz SM : 2100 MHz Memory : 7001 MHz Video : 1950 MHz Max Customer Boost Clocks Graphics : N/A Clock Policy Auto Boost : N/A Auto Boost Default : N/A Voltage Graphics : 893.750 mV Processes GPU instance ID : N/A Compute instance ID : N/A Process ID : 1296 Type : G Name : /usr/bin/gnome-shell Used GPU Memory : 175 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 10576 Type : G Name : /usr/lib/xorg/Xorg Used GPU Memory : 269 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 10708 Type : G Name : /usr/bin/gnome-shell Used GPU Memory : 136 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 11237 Type : G Name : /opt/google/chrome/chrome --type=gpu-process --enable-crashpad --crashpad-handler-pid=11198 --enable-crash-reporter=, --change-stack-guard-on-fork=enable --gpu-preferences=UAAAAAAAAAAgAAAIAAAAAAAAAAAAAAAAAABgAAAAAAAwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAABgAAAAAAAAAGAAAAAAAAAAIAAAAAAAAAAgAAAAAAAAACAAAAAAAAAA= --shared-files --field-trial-handle=0,i,3814663719864301863,1215534421838105235,131072 Used GPU Memory : 310 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 13253 Type : C Name : python Used GPU Memory : 6771 MiB

  • [x] Docker version from docker version

Client: Docker Engine - Community Version: 20.10.13 API version: 1.41 Go version: go1.16.15 Git commit: a224086 Built: Thu Mar 10 14:07:52 2022 OS/Arch: linux/amd64 Context: default Experimental: true

Server: Docker Engine - Community Engine: Version: 20.10.13 API version: 1.41 (minimum version 1.12) Go version: go1.16.15 Git commit: 906f57f Built: Thu Mar 10 14:05:41 2022 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.5.10 GitCommit: 2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc runc: Version: 1.0.3 GitCommit: v1.0.3-0-gf46b6ba docker-init: Version: 0.19.0 GitCommit: de40ad0

  • [x] NVIDIA packages version from dpkg -l '*nvidia*' or rpm -qa '*nvidia*'

dpkg-query: warning: parsing file '/var/lib/dpkg/status' near line 4615 package 'xilinx-cmc-u50': missing maintainer Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-=============================-===================-===================-=============================================================== un libgldispatch0-nvidia (no description available) ii libnvidia-cfg1-470:amd64 470.103.01-0ubuntu0 amd64 NVIDIA binary OpenGL/GLX configuration library un libnvidia-cfg1-any (no description available) un libnvidia-common (no description available) ii libnvidia-common-470 470.103.01-0ubuntu0 all Shared files used by the NVIDIA libraries un libnvidia-compute (no description available) ii libnvidia-compute-470:amd64 470.103.01-0ubuntu0 amd64 NVIDIA libcompute package ii libnvidia-compute-470:i386 470.103.01-0ubuntu0 i386 NVIDIA libcompute package ii libnvidia-container-tools 1.9.0-1 amd64 NVIDIA container runtime library (command-line tools) ii libnvidia-container1:amd64 1.9.0-1 amd64 NVIDIA container runtime library un libnvidia-decode (no description available) ii libnvidia-decode-470:amd64 470.103.01-0ubuntu0 amd64 NVIDIA Video Decoding runtime libraries ii libnvidia-decode-470:i386 470.103.01-0ubuntu0 i386 NVIDIA Video Decoding runtime libraries un libnvidia-encode (no description available) ii libnvidia-encode-470:amd64 470.103.01-0ubuntu0 amd64 NVENC Video Encoding runtime library ii libnvidia-encode-470:i386 470.103.01-0ubuntu0 i386 NVENC Video Encoding runtime library un libnvidia-extra (no description available) ii libnvidia-extra-470:amd64 470.103.01-0ubuntu0 amd64 Extra libraries for the NVIDIA driver un libnvidia-fbc1 (no description available) ii libnvidia-fbc1-470:amd64 470.103.01-0ubuntu0 amd64 NVIDIA OpenGL-based Framebuffer Capture runtime library ii libnvidia-fbc1-470:i386 470.103.01-0ubuntu0 i386 NVIDIA OpenGL-based Framebuffer Capture runtime library un libnvidia-gl (no description available) ii libnvidia-gl-470:amd64 470.103.01-0ubuntu0 amd64 NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD ii libnvidia-gl-470:i386 470.103.01-0ubuntu0 i386 NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD un libnvidia-ifr1 (no description available) ii libnvidia-ifr1-470:amd64 470.103.01-0ubuntu0 amd64 NVIDIA OpenGL-based Inband Frame Readback runtime library ii libnvidia-ifr1-470:i386 470.103.01-0ubuntu0 i386 NVIDIA OpenGL-based Inband Frame Readback runtime library un libnvidia-ml1 (no description available) ii linux-objects-nvidia-510-5.4. 5.4.0-100.113~18.04 amd64 Linux kernel nvidia modules for version 5.4.0-100 (objects) ii linux-signatures-nvidia-5.4.0 5.4.0-100.113~18.04 amd64 Linux kernel signatures for nvidia modules for version 5.4.0-10 un nvidia-304 (no description available) un nvidia-340 (no description available) un nvidia-384 (no description available) un nvidia-390 (no description available) un nvidia-common (no description available) un nvidia-compute-utils (no description available) ii nvidia-compute-utils-470 470.103.01-0ubuntu0 amd64 NVIDIA compute utilities un nvidia-container-runtime (no description available) un nvidia-container-runtime-hook (no description available) ii nvidia-container-toolkit 1.9.0-1 amd64 NVIDIA container runtime hook ii nvidia-dkms-470 470.103.01-0ubuntu0 amd64 NVIDIA DKMS package un nvidia-dkms-kernel (no description available) un nvidia-docker (no description available) ii nvidia-docker2 2.10.0-1 all nvidia-docker CLI wrapper ii nvidia-driver-470 470.103.01-0ubuntu0 amd64 NVIDIA driver metapackage un nvidia-driver-binary (no description available) un nvidia-kernel-common (no description available) ii nvidia-kernel-common-470 470.103.01-0ubuntu0 amd64 Shared files used with the kernel module un nvidia-kernel-source (no description available) ii nvidia-kernel-source-470 470.103.01-0ubuntu0 amd64 NVIDIA kernel source package un nvidia-legacy-340xx-vdpau-dri (no description available) un nvidia-libopencl1 (no description available) un nvidia-libopencl1-dev (no description available) un nvidia-opencl-icd (no description available) un nvidia-persistenced (no description available) ii nvidia-prime 0.8.16~0.18.04.1 all Tools to enable NVIDIA's Prime ii nvidia-settings 470.57.01-0ubuntu0. amd64 Tool for configuring the NVIDIA graphics driver un nvidia-settings-binary (no description available) un nvidia-smi (no description available) un nvidia-utils (no description available) ii nvidia-utils-470 470.103.01-0ubuntu0 amd64 NVIDIA driver support binaries un nvidia-vdpau-driver (no description available) ii xserver-xorg-video-nvidia-470 470.103.01-0ubuntu0 amd64 NVIDIA binary Xorg driver

  • [x] NVIDIA container library version from nvidia-container-cli -V

cli-version: 1.9.0 lib-version: 1.9.0 build date: 2022-03-18T13:46+00:00 build revision: 5e135c17d6dbae861ec343e9a8d3a0d2af758a4f build compiler: x86_64-linux-gnu-gcc-7 7.5.0 build platform: x86_64 build flags: -D_GNU_SOURCE -D_FORTIFY_SOURCE=2 -DNDEBUG -std=gnu11 -O2 -g -fdata-sections -ffunction-sections -fplan9-extensions -fstack-protector -fno-strict-aliasing -fvisibility=hidden -Wall -Wextra -Wcast-align -Wpointer-arith -Wmissing-prototypes -Wnonnull -Wwrite-strings -Wlogical-op -Wformat=2 -Wmissing-format-attribute -Winit-self -Wshadow -Wstrict-prototypes -Wunreachable-code -Wconversion -Wsign-conversion -Wno-unknown-warning-option -Wno-format-extra-args -Wno-gnu-alignof-expression -Wl,-zrelro -Wl,-znow -Wl,-zdefs -Wl,--gc-sections

cat /var/log/nvidia-container-toolkit.log

-- WARNING, the following logs are for debugging purposes only --

I0322 14:29:07.296618 12356 nvc.c:376] initializing library context (version=1.9.0, build=5e135c17d6dbae861ec343e9a8d3a0d2af758a4f) I0322 14:29:07.296648 12356 nvc.c:350] using root / I0322 14:29:07.296652 12356 nvc.c:351] using ldcache /etc/ld.so.cache I0322 14:29:07.296655 12356 nvc.c:352] using unprivileged user 65534:65534 I0322 14:29:07.296671 12356 nvc.c:393] attempting to load dxcore to see if we are running under Windows Subsystem for Linux (WSL) I0322 14:29:07.296725 12356 nvc.c:395] dxcore initialization failed, continuing assuming a non-WSL environment I0322 14:29:07.297389 12363 nvc.c:278] loading kernel module nvidia I0322 14:29:07.297491 12363 nvc.c:282] running mknod for /dev/nvidiactl I0322 14:29:07.297514 12363 nvc.c:286] running mknod for /dev/nvidia0 I0322 14:29:07.297527 12363 nvc.c:290] running mknod for all nvcaps in /dev/nvidia-caps I0322 14:29:07.300727 12363 nvc.c:218] running mknod for /dev/nvidia-caps/nvidia-cap1 from /proc/driver/nvidia/capabilities/mig/config I0322 14:29:07.300827 12363 nvc.c:218] running mknod for /dev/nvidia-caps/nvidia-cap2 from /proc/driver/nvidia/capabilities/mig/monitor I0322 14:29:07.301971 12363 nvc.c:296] loading kernel module nvidia_uvm I0322 14:29:07.302030 12363 nvc.c:300] running mknod for /dev/nvidia-uvm I0322 14:29:07.302075 12363 nvc.c:305] loading kernel module nvidia_modeset I0322 14:29:07.302106 12363 nvc.c:309] running mknod for /dev/nvidia-modeset I0322 14:29:07.302296 12365 rpc.c:71] starting driver rpc service I0322 14:29:07.303938 12366 rpc.c:71] starting nvcgo rpc service I0322 14:29:07.307234 12356 nvc_container.c:240] configuring container with 'compute utility video supervised' I0322 14:29:07.321074 12356 nvc_container.c:262] setting pid to 12339 I0322 14:29:07.321097 12356 nvc_container.c:263] setting rootfs to /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged I0322 14:29:07.321102 12356 nvc_container.c:264] setting owner to 0:0 I0322 14:29:07.321106 12356 nvc_container.c:265] setting bins directory to /usr/bin I0322 14:29:07.321109 12356 nvc_container.c:266] setting libs directory to /usr/lib/x86_64-linux-gnu I0322 14:29:07.321113 12356 nvc_container.c:267] setting libs32 directory to /usr/lib/i386-linux-gnu I0322 14:29:07.321117 12356 nvc_container.c:268] setting cudart directory to /usr/local/cuda I0322 14:29:07.321120 12356 nvc_container.c:269] setting ldconfig to @/sbin/ldconfig.real (host relative) I0322 14:29:07.321124 12356 nvc_container.c:270] setting mount namespace to /proc/12339/ns/mnt I0322 14:29:07.321127 12356 nvc_container.c:272] detected cgroupv1 I0322 14:29:07.321131 12356 nvc_container.c:273] setting devices cgroup to /sys/fs/cgroup/devices/docker/dd964e20110fbaaf13973d696bad3f7f8602ed54ea77288616067585d8307ed7 I0322 14:29:07.321138 12356 nvc_info.c:765] requesting driver information with '' I0322 14:29:07.326225 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/vdpau/libvdpau_nvidia.so.470.103.01 I0322 14:29:07.326820 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvoptix.so.470.103.01 I0322 14:29:07.326875 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-tls.so.470.103.01 I0322 14:29:07.327163 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-rtcore.so.470.103.01 I0322 14:29:07.327476 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.470.103.01 I0322 14:29:07.327738 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.470.103.01 I0322 14:29:07.328023 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.470.103.01 I0322 14:29:07.328333 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ngx.so.470.103.01 I0322 14:29:07.328364 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.470.103.01 I0322 14:29:07.328618 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-ifr.so.470.103.01 I0322 14:29:07.328904 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.470.103.01 I0322 14:29:07.328992 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.470.103.01 I0322 14:29:07.329022 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.470.103.01 I0322 14:29:07.329372 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-fbc.so.470.103.01 I0322 14:29:07.329606 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-encode.so.470.103.01 I0322 14:29:07.329643 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.470.103.01 I0322 14:29:07.329971 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.470.103.01 I0322 14:29:07.330012 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.470.103.01 I0322 14:29:07.330278 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-cbl.so.470.103.01 I0322 14:29:07.330525 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.470.103.01 I0322 14:29:07.330869 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libnvcuvid.so.470.103.01 I0322 14:29:07.331144 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libcuda.so.470.103.01 I0322 14:29:07.331267 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libGLX_nvidia.so.470.103.01 I0322 14:29:07.331501 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libGLESv2_nvidia.so.470.103.01 I0322 14:29:07.331706 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libGLESv1_CM_nvidia.so.470.103.01 I0322 14:29:07.331750 12356 nvc_info.c:172] selecting /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.470.103.01 I0322 14:29:07.332279 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/vdpau/libvdpau_nvidia.so.470.103.01 I0322 14:29:07.332491 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-tls.so.470.103.01 I0322 14:29:07.332931 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-ptxjitcompiler.so.470.103.01 I0322 14:29:07.333165 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-opticalflow.so.470.103.01 I0322 14:29:07.333672 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-opencl.so.470.103.01 I0322 14:29:07.333931 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-ml.so.470.103.01 I0322 14:29:07.334166 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-ifr.so.470.103.01 I0322 14:29:07.334951 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-glvkspirv.so.470.103.01 I0322 14:29:07.335287 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-glsi.so.470.103.01 I0322 14:29:07.335557 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-glcore.so.470.103.01 I0322 14:29:07.335794 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-fbc.so.470.103.01 I0322 14:29:07.336031 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-encode.so.470.103.01 I0322 14:29:07.336253 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-eglcore.so.470.103.01 I0322 14:29:07.336468 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-compiler.so.470.103.01 I0322 14:29:07.336685 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvidia-allocator.so.470.103.01 I0322 14:29:07.336999 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libnvcuvid.so.470.103.01 I0322 14:29:07.337415 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libcuda.so.470.103.01 I0322 14:29:07.337738 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libGLX_nvidia.so.470.103.01 I0322 14:29:07.338030 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libGLESv2_nvidia.so.470.103.01 I0322 14:29:07.338239 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libGLESv1_CM_nvidia.so.470.103.01 I0322 14:29:07.338549 12356 nvc_info.c:172] selecting /usr/lib/i386-linux-gnu/libEGL_nvidia.so.470.103.01 W0322 14:29:07.338578 12356 nvc_info.c:398] missing library libnvidia-nscq.so W0322 14:29:07.338585 12356 nvc_info.c:398] missing library libnvidia-fatbinaryloader.so W0322 14:29:07.338599 12356 nvc_info.c:398] missing library libnvidia-pkcs11.so W0322 14:29:07.338604 12356 nvc_info.c:402] missing compat32 library libnvidia-cfg.so W0322 14:29:07.338610 12356 nvc_info.c:402] missing compat32 library libnvidia-nscq.so W0322 14:29:07.338615 12356 nvc_info.c:402] missing compat32 library libnvidia-fatbinaryloader.so W0322 14:29:07.338620 12356 nvc_info.c:402] missing compat32 library libnvidia-pkcs11.so W0322 14:29:07.338625 12356 nvc_info.c:402] missing compat32 library libnvidia-ngx.so W0322 14:29:07.338630 12356 nvc_info.c:402] missing compat32 library libnvidia-rtcore.so W0322 14:29:07.338636 12356 nvc_info.c:402] missing compat32 library libnvoptix.so W0322 14:29:07.338641 12356 nvc_info.c:402] missing compat32 library libnvidia-cbl.so I0322 14:29:07.338845 12356 nvc_info.c:298] selecting /usr/bin/nvidia-smi I0322 14:29:07.338865 12356 nvc_info.c:298] selecting /usr/bin/nvidia-debugdump I0322 14:29:07.338886 12356 nvc_info.c:298] selecting /usr/bin/nvidia-persistenced I0322 14:29:07.338922 12356 nvc_info.c:298] selecting /usr/bin/nvidia-cuda-mps-control I0322 14:29:07.338940 12356 nvc_info.c:298] selecting /usr/bin/nvidia-cuda-mps-server W0322 14:29:07.339125 12356 nvc_info.c:424] missing binary nv-fabricmanager I0322 14:29:07.339396 12356 nvc_info.c:342] listing firmware path /lib/firmware/nvidia/470.103.01/gsp.bin I0322 14:29:07.339424 12356 nvc_info.c:528] listing device /dev/nvidiactl I0322 14:29:07.339430 12356 nvc_info.c:528] listing device /dev/nvidia-uvm I0322 14:29:07.339436 12356 nvc_info.c:528] listing device /dev/nvidia-uvm-tools I0322 14:29:07.339441 12356 nvc_info.c:528] listing device /dev/nvidia-modeset I0322 14:29:07.339463 12356 nvc_info.c:342] listing ipc path /run/nvidia-persistenced/socket W0322 14:29:07.339480 12356 nvc_info.c:348] missing ipc path /var/run/nvidia-fabricmanager/socket W0322 14:29:07.339496 12356 nvc_info.c:348] missing ipc path /tmp/nvidia-mps I0322 14:29:07.339502 12356 nvc_info.c:821] requesting device information with '' I0322 14:29:07.346170 12356 nvc_info.c:712] listing device /dev/nvidia0 (GPU-24280536-bac0-f86c-3f64-d445498d60a8 at 00000000:01:00.0) I0322 14:29:07.346263 12356 nvc_mount.c:366] mounting tmpfs at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/proc/driver/nvidia I0322 14:29:07.346833 12356 nvc_mount.c:134] mounting /usr/bin/nvidia-smi at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/bin/nvidia-smi I0322 14:29:07.346880 12356 nvc_mount.c:134] mounting /usr/bin/nvidia-debugdump at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/bin/nvidia-debugdump I0322 14:29:07.346910 12356 nvc_mount.c:134] mounting /usr/bin/nvidia-persistenced at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/bin/nvidia-persistenced I0322 14:29:07.346938 12356 nvc_mount.c:134] mounting /usr/bin/nvidia-cuda-mps-control at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/bin/nvidia-cuda-mps-control I0322 14:29:07.346965 12356 nvc_mount.c:134] mounting /usr/bin/nvidia-cuda-mps-server at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/bin/nvidia-cuda-mps-server I0322 14:29:07.350265 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.470.103.01 I0322 14:29:07.350377 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.470.103.01 I0322 14:29:07.350546 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libcuda.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libcuda.so.470.103.01 I0322 14:29:07.350606 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.470.103.01 I0322 14:29:07.350709 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.470.103.01 I0322 14:29:07.350758 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.470.103.01 I0322 14:29:07.350925 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.470.103.01 I0322 14:29:07.351094 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/vdpau/libvdpau_nvidia.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libvdpau_nvidia.so.470.103.01 I0322 14:29:07.351351 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-encode.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-encode.so.470.103.01 I0322 14:29:07.351551 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.470.103.01 I0322 14:29:07.351666 12356 nvc_mount.c:134] mounting /usr/lib/x86_64-linux-gnu/libnvcuvid.so.470.103.01 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvcuvid.so.470.103.01 I0322 14:29:07.351702 12356 nvc_mount.c:527] creating symlink /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libcuda.so -> libcuda.so.1 I0322 14:29:07.351854 12356 nvc_mount.c:527] creating symlink /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so -> libnvidia-opticalflow.so.1 I0322 14:29:07.352429 12356 nvc_mount.c:85] mounting /lib/firmware/nvidia/470.103.01/gsp.bin at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/lib/firmware/nvidia/470.103.01/gsp.bin with flags 0x7 I0322 14:29:07.352802 12356 nvc_mount.c:261] mounting /run/nvidia-persistenced/socket at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/run/nvidia-persistenced/socket I0322 14:29:07.352874 12356 nvc_mount.c:230] mounting /dev/nvidiactl at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/dev/nvidiactl I0322 14:29:07.353199 12356 nvc_mount.c:230] mounting /dev/nvidia-uvm at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/dev/nvidia-uvm I0322 14:29:07.353376 12356 nvc_mount.c:230] mounting /dev/nvidia-uvm-tools at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/dev/nvidia-uvm-tools I0322 14:29:07.353498 12356 nvc_mount.c:230] mounting /dev/nvidia0 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/dev/nvidia0 I0322 14:29:07.353590 12356 nvc_mount.c:440] mounting /proc/driver/nvidia/gpus/0000:01:00.0 at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged/proc/driver/nvidia/gpus/0000:01:00.0 I0322 14:29:07.353699 12356 nvc_ldcache.c:372] executing /sbin/ldconfig.real from host at /var/lib/docker/overlay2/b2b7bcaf9cac4cae9679ba4197dcc63394fe59978035be2036bf0ae4ab168649/merged I0322 14:29:07.811337 12356 nvc.c:430] shutting down library context I0322 14:29:07.811511 12366 rpc.c:95] terminating nvcgo rpc service I0322 14:29:07.812394 12356 rpc.c:135] nvcgo rpc service terminated successfully I0322 14:29:07.813514 12365 rpc.c:95] terminating driver rpc service I0322 14:29:07.813847 12356 rpc.c:135] driver rpc service terminated successfully

  • [x] Docker command, image and tag used

docker run -it --name rvms --gpus all -v /home/chenjiyang/rvms/:/rvms nvcr.io/nvidia/tensorflow:20.03-tf2-py3

jedichen121 avatar Mar 22 '22 14:03 jedichen121