noobaa-core
noobaa-core copied to clipboard
Improve list objects performance on top of NS FS
Environment info
- NooBaa Version: VERSION
- Platform: Kubernetes 1.14.1 | minikube 1.1.1 | OpenShift 4.1 | other: specify
Actual behavior
- All directory entries are brought to memory and ordered (FS doesn't return it in order), saved in cache
- If the directory size is larger than the cache size (64MB defaulted). then on each list command we bring everything to mem and organize
Expected behavior
- Add a config per account to return un-ordered list object (list v2 only)
- Still need to support pagination and delimiter, prefix
Steps to reproduce
More information - Screenshots / Logs / Other output
Should / Can use https://man7.org/linux/man-pages/man3/telldir.3.html https://man7.org/linux/man-pages/man3/seekdir.3.html