nextcloud
Searching in trashbin over-loads server
I have FullTextSearch, FullTextSearch_ElasticSearch, Files_FullTextSearch and Full text search - Files - Tesseract OCR installed on Nextcloud-24.04 on Ubuntu-20.04 with PHP-7.4.3 and MariaDB-10.5.16. The server is a quad-core with 16 GB RAM. Searching works fine unless done so from the trashbin ('deleted files'). In that situation, I observe the following:
- the search entry text box becomes unresponsive immediately after typing the very first character, a "blindly" typed second character does appear later on, though,.
- the number of php-fpm threads jumps from 22 to 125
- system load as provided by 'top' increases from 0.4 to values of up to 40
- memory consumption reaches 95% of 16 GB
- swap consumption does not seem to increase
- the website does not respond
After approximately 10 minutes, the search results are presented and the system returns to a normal load and memory consumption, and also the number of php-fpm threads drops back to the original 22.
Furthermore the search term can be changed by adding or deleting characters and the results adapt within approximately one minute, even -- and this seems remarkable -- if the search term is completely deleted and replaced. Server load land number of php-fpm threads increase only slightly during this period. The search entry text box remains unresponsive, nevertheless.
Neither PHP7.4-fpm nor Elasticsearch show anything noteworthy in their logs. In the web server error log there are repeated entries of type 2022/08/18 09:06:01 [error] 118#118: *622146 connect() to unix:/run/php/php7.4-fpm.sock failed (11: Resource temporarily unavailable) while connecting to upstream, client: 192.168.1.102, server: lxcnextcloud, request: "GET /apps/files_trashbin/preview?fileId=682653&file=SofortUpload%2Fpix%2F_xport%2F20200907_7.jpg%2F20200907_7.jpg.d1599668497&c=1599668497 HTTP/1.0", upstream: "fastcgi://unix:/run/php/php7.4-fpm.sock:", host: "nextcloud.DOMAIN", referrer: "https://nextcloud.DOMAIN/apps/files/?dir=/&view=trashbin". To me, they look related to general system over-load.
The user data consists of 316GB under 'files/' and 190GB under 'files_trashbin/'. I remember having stumbled over this issue already on earlier versions of Nextcloud but have never taken a closer look at it up until now.
