cloud-pipeline icon indicating copy to clipboard operation
cloud-pipeline copied to clipboard

Support autoscaling for Lustre FS

Open okolesn opened this issue 6 months ago • 0 comments

Background At the moment, Cloud Pipeline does not autoscale Lustre FS. We need to create script to automatically increase disk capacity when disk is going to be full like for 'btrfs' FS type.

Details Update FS documantation

  1. There are 4 deployment types for Lustre FS: SCRATCH_1, SCRATCH_2, PERSISTENT_1 and PERSISTENT_2. For SCRATCH_1 type update size is not allowed. We should notify user that autoscaling option won't be available.
  2. Valid storage capacity target values are in multiples of 2400 GiB.
  3. Update time is about half an hour.

Test details Memory allocation does not work for Lustre FS type. 'dd if=/dev/zero of=largefile.bin bs=100M count=1024' command can be used (it creates 100G file in the current disk).

okolesn avatar May 09 '25 08:05 okolesn