Warp with small objects

[javieramirez1]

Environment info

• NooBaa Version: VERSION
• Platform: Kubernetes 1.14.1 | minikube 1.1.1 | OpenShift 4.1 | other: specify [root@c83f2-dan9 ~]# rpm -qa | grep s3 gpfs.mms3-5.2.1-0.240617.104624.el9.x86_64 [root@c83f2-dan9 ~]# rpm -qa | grep noobaa noobaa-core-5.15.4-20240611.el9.x86_64

Actual behavior

1. when im trying to run 100 warp instances (25 for each app node) in order to use 100 accounts (one for each instance) in addition to using 20 connections per instance (2000 in total) for small objects where these errors were seen:

noobaa.log:

2024-06-07T06:13:29.739738-04:00 c83f2-dan9 node[3192156]: [nsfs/3192156] [ERROR] CONSOLE:: nsfs: exit on error Error: failed to create NSFS system data due to - ENOENT: no such file or directory, unlink '/gpfs/remote_rw_cessharedroot/ces/s3-config/system.json.lx4j3mkp-458a72e6' at init_nsfs_system (/usr/local/noobaa-core/src/cmd/nsfs.js:233:23) at async main (/usr/local/noobaa-core/src/cmd/nsfs.js:320:27) 2024-06-07T06:13:34.236337-04:00 c83f2-dan9 node[3192178]: [nsfs/3192178] [ERROR] CONSOLE:: failed to create NSFS system data due to - ENOENT: no such file or directory, unlink '/gpfs/remote_rw_cessharedroot/ces/s3-config/system.json.lx4j3q1h-fbdf2057' [Error: ENOENT: no such file or directory, unlink '/gpfs/remote_rw_cessharedroot/ces/s3-config/system.json.lx4j3q1h-fbdf2057'] { errno: -2, code: 'ENOENT', syscall: 'unlink', path: '/gpfs/remote_rw_cessharedroot/ces/s3-config/system.json.lx4j3q1h-fbdf2057' }

Expected behavior

1. 100 instances of warp complete

Steps to reproduce

1. run 100 instances of warp using 20 conecctions per node

More information - Screenshots / Logs / Other output