ndctl icon indicating copy to clipboard operation
ndctl copied to clipboard

No numa node id from ndctl list -uv on CentOS 7

Open yuelimv opened this issue 5 years ago • 3 comments

$ ndctl --version
65

$ cat /etc/centos-release
CentOS Linux release 7.7.1908 (Core)

$ uname -a
Linux kimber 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

$ ndctl list -uv
[
  {
    "dev":"namespace1.2",
    "mode":"devdax",
    "map":"dev",
    "size":"98.44 GiB (105.69 GB)",
    "uuid":"04d40640-c069-4ad5-b974-fc0c9070f65c",
    "raw_uuid":"11c8fef0-14e4-42df-a666-bcbdcb47eff7",
    "daxregion":{
      "id":1,
      "size":"98.44 GiB (105.69 GB)",
      "align":2097152,
      "devices":[
        {
          "chardev":"dax1.2",
          "size":"98.44 GiB (105.69 GB)"
        }
      ]
    },
    "align":2097152
  },

While the same command in CentOS 8 does provide the numa id field.

yuelimv avatar Aug 26 '20 07:08 yuelimv

@yuelimv ndctl gets the numa_node attribute from sysfs:

# cat /sys/bus/nd/devices/namespace5.0/numa_node 
1

If it is missing, we might need to look on the kernel side. Is NUMA enabled in your config? Does numactl -H show the expected numa topology? Is the above numa_node sysfs file present for your namespace?

stellarhopper avatar Aug 27 '20 20:08 stellarhopper

I got:

[ yli@kimber(4.08,) 2:22:16pm ] ~
$ cat /sys/bus/nd/devices/namespace1.2/numa_node
-1
[ yli@kimber(4.07,) 2:22:23pm ] ~
$ numactl -H
available: 2 nodes (0-1)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71
node 0 size: 97976 MB
node 0 free: 66248 MB
node 1 cpus: 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95
node 1 size: 98304 MB
node 1 free: 71122 MB
node distances:
node   0   1
  0:  10  21
  1:  21  10

yuelimv avatar Aug 27 '20 21:08 yuelimv

related/duplicate https://github.com/pmem/ndctl/issues/130

tanabarr avatar Oct 14 '20 14:10 tanabarr