operations icon indicating copy to clipboard operation
operations copied to clipboard

Resize NVMe sector size on snap-01

Open Firefishy opened this issue 1 year ago • 1 comments

The NVMe disks in snap-01 are using 512 sectors instead of 4096 byte sectors. The sector size should likely be changed if boosts performance.

LBA Format  0 : Metadata Size: 0   bytes - Data Size: 512 bytes - Relative Performance: 0 Best (in use)
LBA Format  1 : Metadata Size: 0   bytes - Data Size: 4096 bytes - Relative Performance: 0 Best

Changing the disk sector size formats the disk, the sector size needs to be carefully coordinated with mdadm.

Outline steps:

  1. Confirm array idle via /proc/mdstats
  2. mdadm --fail
  3. mdadm --remove
  4. nvme format --lbaf=1
  5. mdadm --add

(repeat disk by disk across all 9 disks)

Firefishy avatar Aug 08 '24 16:08 Firefishy

Related #1139

Firefishy avatar Aug 08 '24 16:08 Firefishy

On reflection the small risk of doing this exceeds the presumed benefit. Maybe if the machine was pooled from pool it could be considered, but not while it runs primary.

Firefishy avatar Feb 19 '25 07:02 Firefishy