memories icon indicating copy to clipboard operation
memories copied to clipboard

After 7.1.0 update system logging show error failed to index

Open irfancyp opened this issue 1 year ago • 6 comments

Raw error data

{"reqId":"UbsQrUjoi9InjC0fi9Xt","level":3,"time":"2024-04-02T19:42:58+03:00","remoteAddr":"","user":"--","app":"memories","method":"","url":"--","message":"Failed to index folder /6E20702E-824A-4C48-8B2B-D3B11C81DE70/files/Releases/A Xxcc: Invalid request for /Share/Original%20Design/xxxxx%20BOYA%20GRUBU/.nomedia (InvalidArgumentException)","userAgent":"--","version":"28.0.4.1","data":{"app":"memories"},"id":"660c48d98be08"}

Any advice how to fix ?

irfancyp avatar Apr 02 '24 18:04 irfancyp

No idea what's happening here. Any more info on the setup? Does this happen with this specific folder? Output of occ memories:index -f?

pulsejet avatar Apr 02 '24 22:04 pulsejet

its been few hours now and problem seems to go away by running below commands. if same problem shows up again I will let you know

sudo -u www-data /usr/bin/php /var/www/nextcloud/occ files:scan --all sudo -u www-data /usr/bin/php /var/www/nextcloud/occ files:scan-app-data -vvv sudo bash -c 'for i in {1..4}; do (sudo -u www-data /usr/bin/php /var/www/nextcloud/occ memories:index &); done' sudo reboot now

irfancyp avatar Apr 04 '24 11:04 irfancyp

Spoke too soon. I have many records similiar to below. Like 600 records per auto index time. I have noticed that all error files are on default share folder which in my case is named releases

{"reqId":"PW7A9NzX6Jrii256uNcX","level":3,"time":"2024-04-06T08:12:44+03:00","remoteAddr":"","user":"--","app":"memories","method":"","url":"--","message":"Failed to index folder /6F853749-060F-4B5D-84FF-8F3A42695713/files/Releases/Xxx xxx: Invalid request for /Share/Original%20Design/xxx/xxx%20xxx%20GRUBU/.nomedia (InvalidArgumentException)","userAgent":"--","version":"28.0.4.1","data":{"app":"memories"},"id":"6610e322b9552"}

irfancyp avatar Apr 06 '24 06:04 irfancyp

Operating System: Linux 5.15.0-101-generic x86_64

CPU: Intel(R) Xeon(R) Gold 5220R CPU @ 2.20GHz (12 cores)

Memory: 15.61 GB

PHP Version: 8.1.23

Memory limit: 1 GB

Max execution time: 3600

Upload max size: 10 GB

OPcache Revalidate Frequency: 60

Extensions: Core, date, libxml, openssl, pcre, zlib, filter, hash, json, Reflection, SPL, session, standard, sodium, cgi-fcgi, mysqlnd, PDO, xml, apcu, bcmath, bz2, calendar, ctype, curl, dom, mbstring, FFI, fileinfo, ftp, gd, gettext, gmp, iconv, igbinary, imagick, intl, ldap, exif, mysqli, pdo_mysql, Phar, posix, readline, redis, shmop, SimpleXML, smbclient, sockets, sysvmsg, sysvsem, sysvshm, tokenizer, xmlreader, xmlwriter, xsl, zip, libsmbclient, Zend OPcache

Database Type: mysql

Version: 10.11.1

Size: 5.2 GB

irfancyp avatar Apr 06 '24 06:04 irfancyp

I have noticed that some users were obsolete. So may be those users shared files are causing the issue, so I run below command to delete obsolete users.

I will let you know if problem continues.

#displays a table with all users that have been marked as deleted, and their LDAP data. sudo -u www-data php /var/www/nextcloud/occ ldap:show-remnants

#removes the user’s data from the Nextcloud data directory. #sudo -u www-data php /var/www/nextcloud/occ user:delete [user] sudo -u www-data php /var/www/nextcloud/occ user:delete "FADE9875-DF76-4D41-B4C8-9DBF8114F9E1"

irfancyp avatar Apr 06 '24 09:04 irfancyp

this is our config.php

$CONFIG = array ( 'passwordsalt' => 'xxx', 'secret' => 'xxx', 'trusted_domains' => array ( 0 => 'xxx', 1 => 'xx.xxx.xx', ), 'datadirectory' => '/home/data', 'dbtype' => 'mysql', 'version' => '28.0.1.1', 'overwrite.cli.url' => 'https://xxxx', 'dbname' => 'xxx', 'dbhost' => 'localhost', 'dbport' => '', 'dbtableprefix' => 'oc_', 'mysql.utf8mb4' => true, 'dbuser' => 'xxx', 'dbpassword' => 'xxx', 'installed' => true, 'instanceid' => 'xxx', 'activity_expire_days' => 14, 'auth.bruteforce.protection.enabled' => true, 'blacklisted_files' => array ( 0 => '.htaccess', 1 => 'Thumbs.db', 2 => 'thumbs.db', ), 'cron_log' => true, 'default_phone_region' => 'TR', 'enable_previews' => true, 'enabledPreviewProviders' => array ( 0 => 'OC\Preview\PNG', 1 => 'OC\Preview\JPEG', 2 => 'OC\Preview\GIF', 3 => 'OC\Preview\BMP', 4 => 'OC\Preview\XBitmap', 5 => 'OC\Preview\Movie', 6 => 'OC\Preview\PDF', 7 => 'OC\Preview\MP3', 8 => 'OC\Preview\TXT', 9 => 'OC\Preview\MarkDown', ), 'maintenance_window_start' => 100, 'filesystem_check_changes' => 0, 'filelocking.enabled' => 'true', 'htaccess.RewriteBase' => '/', 'integrity.check.disabled' => false, 'knowledgebaseenabled' => false, 'log_rotate_size' => 104857600, 'logfile' => '/var/log/nextcloud/nextcloud.log', 'loglevel' => 2, 'logtimezone' => 'Europe/Helsinki', 'memcache.local' => '\OC\Memcache\APCu', 'memcache.locking' => '\OC\Memcache\Redis', 'overwriteprotocol' => 'https', 'preview_max_x' => 1024, 'preview_max_y' => 768, 'preview_max_scale_factor' => 1, 'redis' => array ( 'host' => '/var/run/redis/redis-server.sock', 'port' => 0, 'timeout' => 0.0, ), 'quota_include_external_storage' => false, 'share_folder' => '/Releases', 'skeletondirectory' => '', 'trashbin_retention_obligation' => 'auto, 7', 'mail_from_address' => 'dr', 'mail_smtpdebug' => false, 'mail_smtpmode' => 'smtp', 'mail_sendmailmode' => 'smtp', 'mail_domain' => 'xxx', 'mail_smtphost' => 'xxx', 'mail_smtpport' => '25', 'maintenance' => false, 'theme' => '', 'updater.release.channel' => 'stable', 'mail_smtpauth' => 1, 'mail_smtpname' => 'xxx', 'mail_smtppassword' => 'xxx', 'ldapProviderFactory' => 'OCA\User_LDAP\LDAPProviderFactory', );

irfancyp avatar Apr 06 '24 09:04 irfancyp