core icon indicating copy to clipboard operation
core copied to clipboard
verified publisher icon owncloud

Database error when stress testing

Open jnweiger opened this issue 2 years ago • 2 comments

Seen with 10.13.2-rc.1 on a hetzner cloud machine with one virtual cpu

  • Add 25000 photos to the Photos folder of user admin

  • run occ file:scan --all

  • connect a web browser and visit the Photos folder

  • watch how thumbnails get generated.

  • open the gallery app, this seems to generate thumbnails faster.

  • after a while, occ file:scan is still running, an error is reported:

 occ file:scan --all                                                              
Scanning files for 10 users
Starting scan for user 1 out of 10 (9918b614-6a2e-103b-89a7-f5edf5d332f5)
Starting scan for user 2 out of 10 (Alice)
Starting scan for user 3 out of 10 (aca4c3ec-691d-103b-8380-55a4da3d3a76)
Starting scan for user 4 out of 10 (admin)

Exception during scan: Doctrine\DBAL\ConnectionException: Transaction commit failed because the transaction has been marked for rollback only.
#0 /var/www/owncloud/lib/composer/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(1772): Doctrine\DBAL\ConnectionException::commitFailedRollbackOnly()
#1 /var/www/owncloud/lib/private/Files/Cache/Propagator.php(191): Doctrine\DBAL\Connection->commit()
#2 /var/www/owncloud/lib/private/Files/Utils/Scanner.php(252): OC\Files\Cache\Propagator->commitBatch()
#3 /var/www/owncloud/apps/files/lib/Command/Scan.php(250): OC\Files\Utils\Scanner->scan()
#4 /var/www/owncloud/apps/files/lib/Command/Scan.php(400): OCA\Files\Command\Scan->scanFiles()
#5 /var/www/owncloud/apps/files/lib/Command/Scan.php(362): OCA\Files\Command\Scan->userScan()
#6 /var/www/owncloud/apps/files/lib/Command/Scan.php(327): OCA\Files\Command\Scan->processUserChunks()
#7 /var/www/owncloud/lib/composer/symfony/console/Command/Command.php(298): OCA\Files\Command\Scan->execute()
#8 /var/www/owncloud/core/Command/Base.php(159): Symfony\Component\Console\Command\Command->run()
#9 /var/www/owncloud/lib/composer/symfony/console/Application.php(1040): OC\Core\Command\Base->run()
#10 /var/www/owncloud/lib/composer/symfony/console/Application.php(301): Symfony\Component\Console\Application->doRunCommand()
#11 /var/www/owncloud/lib/composer/symfony/console/Application.php(171): Symfony\Component\Console\Application->doRun()
#12 /var/www/owncloud/lib/private/Console/Application.php(165): Symfony\Component\Console\Application->run()
#13 /var/www/owncloud/console.php(94): OC\Console\Application->run()
#14 /var/www/owncloud/occ(11): require_once('/var/www/ownclo...')
#15 {main}
Starting scan for user 5 out of 10 (bob)
Exception during scan: Doctrine\DBAL\ConnectionException: Transaction commit failed because the transaction has been marked for rollback only.
#0 /var/www/owncloud/lib/composer/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(1772): Doctrine\DBAL\ConnectionException::commitFailedRollbackOnly()
#1 /var/www/owncloud/lib/private/Files/Cache/Propagator.php(191): Doctrine\DBAL\Connection->commit()
#2 /var/www/owncloud/lib/private/Files/Utils/Scanner.php(252): OC\Files\Cache\Propagator->commitBatch()
#3 /var/www/owncloud/apps/files/lib/Command/Scan.php(250): OC\Files\Utils\Scanner->scan()
#4 /var/www/owncloud/apps/files/lib/Command/Scan.php(400): OCA\Files\Command\Scan->scanFiles()
#5 /var/www/owncloud/apps/files/lib/Command/Scan.php(362): OCA\Files\Command\Scan->userScan()
#6 /var/www/owncloud/apps/files/lib/Command/Scan.php(327): OCA\Files\Command\Scan->processUserChunks()
#7 /var/www/owncloud/lib/composer/symfony/console/Command/Command.php(298): OCA\Files\Command\Scan->execute()
#8 /var/www/owncloud/core/Command/Base.php(159): Symfony\Component\Console\Command\Command->run()
#9 /var/www/owncloud/lib/composer/symfony/console/Application.php(1040): OC\Core\Command\Base->run()
#10 /var/www/owncloud/lib/composer/symfony/console/Application.php(301): Symfony\Component\Console\Application->doRunCommand()
#11 /var/www/owncloud/lib/composer/symfony/console/Application.php(171): Symfony\Component\Console\Application->doRun()
#12 /var/www/owncloud/lib/private/Console/Application.php(165): Symfony\Component\Console\Application->run()
#13 /var/www/owncloud/console.php(94): OC\Console\Application->run()
#14 /var/www/owncloud/occ(11): require_once('/var/www/ownclo...')
#15 {main}
Starting scan for user 6 out of 10 (c298ae18-6a2e-103b-89a8-f5edf5d332f5)
....

The server log has

{"reqId":"ZR-Q0qqQMVS0Y4@IZ2Td3AAAAAM","level":4,"time":"2023-10-06T09:19:02+00:00","remoteAddr":"46.114.212.72","user":"admin","app":"webdav","method":"GET","url":"\/remote.php\/dav\/files\/admin\/Photos\/10\/randimg_100x106a3344x2543.png?c=cd81fb1e8b41b749571674f7f6e616d6&x=32&y=32&forceIcon=0&preview=1","message":"Exception: HTTP\/1.1 400 An exception occurred while executing 'INSERT INTO `oc_filecache` (`mimepart`, `mimetype`, `mtime`, `size`, `etag`, `storage_mtime`, `permissions`, `checksum`, `parent`, `path_hash`, `path`, `name`, `storage`) VALUES(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' with params [\"5\", \"10\", 1696583891, 2003, \"6adc643428ae712855d9dd55dec6b7b3\", 1696583891, 27, \"SHA1:9eb3f00b6cf7b2a253df6f02f52152a59d30d137 MD5:407773dd3af62dad2d8063ea3508c2f9 ADLER32:8131bd3b\", 58244, \"ecc7407d9fe4ea1d5241370977fdb506\", \"thumbnails\\\/17472\\\/32-32.png\", \"32-32.png\", 4]:\n\nSQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction: {\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\BadRequest\",\"Message\":\"An exception occurred while executing 'INSERT INTO `oc_filecache` (`mimepart`, `mimetype`, `mtime`, `size`, `etag`, `storage_mtime`, `permissions`, `checksum`, `parent`, `path_hash`, `path`, `name`, `storage`) VALUES(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' with params [\\\"5\\\", \\\"10\\\", 1696583891, 2003, \\\"6adc643428ae712855d9dd55dec6b7b3\\\", 1696583891, 27, \\\"SHA1:9eb3f00b6cf7b2a253df6f02f52152a59d30d137 MD5:407773dd3af62dad2d8063ea3508c2f9 ADLER32:8131bd3b\\\", 58244, \\\"ecc7407d9fe4ea1d5241370977fdb506\\\", \\\"thumbnails\\\\\\\/17472\\\\\\\/32-32.png\\\", \\\"32-32.png\\\", 4]:\\n\\nSQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/event\\\/lib\\\/WildcardEmitterTrait.php(89): OCA\\\\DAV\\\\Files\\\\PreviewPlugin->httpGet()\\n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(472): Sabre\\\\DAV\\\\Server->emit()\\n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(253): Sabre\\\\DAV\\\\Server->invokeMethod()\\n#3 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Server.php(348): Sabre\\\\DAV\\\\Server->start()\\n#4 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(31): OCA\\\\DAV\\\\Server->exec()\\n#5 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#6 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Files\\\/PreviewPlugin.php\",\"Line\":156}"}
{"reqId":"ZR-Q0qqQMVS0Y4@IZ2Td3AAAAAM","level":4,"time":"2023-10-06T09:19:02+00:00","remoteAddr":"46.114.212.72","user":"admin","app":"webdav","method":"GET","url":"\/remote.php\/dav\/files\/admin\/Photos\/10\/randimg_100x106a3344x2543.png?c=cd81fb1e8b41b749571674f7f6e616d6&x=32&y=32&forceIcon=0&preview=1","message":"Caused by: {\"Exception\":\"Doctrine\\\\DBAL\\\\Exception\\\\LockWaitTimeoutException\",\"Message\":\"An exception occurred while executing 'INSERT INTO `oc_filecache` (`mimepart`, `mimetype`, `mtime`, `size`, `etag`, `storage_mtime`, `permissions`, `checksum`, `parent`, `path_hash`, `path`, `name`, `storage`) VALUES(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' with params [\\\"5\\\", \\\"10\\\", 1696583891, 2003, \\\"6adc643428ae712855d9dd55dec6b7b3\\\", 1696583891, 27, \\\"SHA1:9eb3f00b6cf7b2a253df6f02f52152a59d30d137 MD5:407773dd3af62dad2d8063ea3508c2f9 ADLER32:8131bd3b\\\", 58244, \\\"ecc7407d9fe4ea1d5241370977fdb506\\\", \\\"thumbnails\\\\\\\/17472\\\\\\\/32-32.png\\\", \\\"32-32.png\\\", 4]:\\n\\nSQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/DBALException.php(182): Doctrine\\\\DBAL\\\\Driver\\\\AbstractMySQLDriver->convertException()\\n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/DBALException.php(159): Doctrine\\\\DBAL\\\\DBALException::wrapException()\\n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(2226): Doctrine\\\\DBAL\\\\DBALException::driverExceptionDuringQuery()\\n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(1538): Doctrine\\\\DBAL\\\\Connection->handleExceptionDuringQuery()\\n#4 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(238): Doctrine\\\\DBAL\\\\Connection->executeStatement()\\n#5 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Query\\\/QueryBuilder.php(216): OC\\\\DB\\\\Connection->executeStatement()\\n#6 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/QueryBuilder\\\/QueryBuilder.php(141): Doctrine\\\\DBAL\\\\Query\\\\QueryBuilder->execute()\\n#7 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Adapter.php(201): OC\\\\DB\\\\QueryBuilder\\\\QueryBuilder->execute()\\n#8 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(291): OC\\\\DB\\\\Adapter->upsert()\\n#9 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(328): OC\\\\DB\\\\Connection->upsert()\\n#10 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(281): OC\\\\Files\\\\Cache\\\\Cache->insert()\\n#11 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(281): OC\\\\Files\\\\Cache\\\\Cache->put()\\n#12 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(218): OC\\\\Files\\\\Cache\\\\Scanner->addToCache()\\n#13 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(326): OC\\\\Files\\\\Cache\\\\Scanner->scanFile()\\n#14 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Updater.php(124): OC\\\\Files\\\\Cache\\\\Scanner->scan()\\n#15 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(336): OC\\\\Files\\\\Cache\\\\Updater->update()\\n#16 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1241): OC\\\\Files\\\\View->writeUpdate()\\n#17 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(752): OC\\\\Files\\\\View->basicOperation()\\n#18 \\\/var\\\/www\\\/owncloud\\\/lib\\\/public\\\/Events\\\/EventEmitterTrait.php(50): OC\\\\Files\\\\View->OC\\\\Files\\\\{closure}(*** sensitive parameters replaced ***)\\n#19 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(754): OC\\\\Files\\\\View->emittingCall()\\n#20 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1029): OC\\\\Files\\\\View->file_put_contents()\\n#21 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(865): OC\\\\Preview->storePreview()\\n#22 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1145): OC\\\\Preview->resizeAndStore()\\n#23 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(738): OC\\\\Preview->generatePreview()\\n#24 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Node\\\/File.php(170): OC\\\\Preview->getPreview()\\n#25 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Files\\\/PreviewPlugin.php(115): OC\\\\Files\\\\Node\\\\File->getThumbnail()\\n#26 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/event\\\/lib\\\/WildcardEmitterTrait.php(89): OCA\\\\DAV\\\\Files\\\\PreviewPlugin->httpGet()\\n#27 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(472): Sabre\\\\DAV\\\\Server->emit()\\n#28 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(253): Sabre\\\\DAV\\\\Server->invokeMethod()\\n#29 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Server.php(348): Sabre\\\\DAV\\\\Server->start()\\n#30 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(31): OCA\\\\DAV\\\\Server->exec()\\n#31 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#32 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Driver\\\/AbstractMySQLDriver.php\",\"Line\":54}"}
{"reqId":"ZR-Q0qqQMVS0Y4@IZ2Td3AAAAAM","level":4,"time":"2023-10-06T09:19:02+00:00","remoteAddr":"46.114.212.72","user":"admin","app":"webdav","method":"GET","url":"\/remote.php\/dav\/files\/admin\/Photos\/10\/randimg_100x106a3344x2543.png?c=cd81fb1e8b41b749571674f7f6e616d6&x=32&y=32&forceIcon=0&preview=1","message":"Caused by: {\"Exception\":\"Doctrine\\\\DBAL\\\\Driver\\\\PDO\\\\Exception\",\"Message\":\"SQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction\",\"Code\":\"HY000\",\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Driver\\\/PDOStatement.php(119): Doctrine\\\\DBAL\\\\Driver\\\\PDO\\\\Exception::new()\\n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(1527): Doctrine\\\\DBAL\\\\Driver\\\\PDOStatement->execute()\\n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(238): Doctrine\\\\DBAL\\\\Connection->executeStatement()\\n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Query\\\/QueryBuilder.php(216): OC\\\\DB\\\\Connection->executeStatement()\\n#4 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/QueryBuilder\\\/QueryBuilder.php(141): Doctrine\\\\DBAL\\\\Query\\\\QueryBuilder->execute()\\n#5 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Adapter.php(201): OC\\\\DB\\\\QueryBuilder\\\\QueryBuilder->execute()\\n#6 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(291): OC\\\\DB\\\\Adapter->upsert()\\n#7 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(328): OC\\\\DB\\\\Connection->upsert()\\n#8 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(281): OC\\\\Files\\\\Cache\\\\Cache->insert()\\n#9 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(281): OC\\\\Files\\\\Cache\\\\Cache->put()\\n#10 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(218): OC\\\\Files\\\\Cache\\\\Scanner->addToCache()\\n#11 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(326): OC\\\\Files\\\\Cache\\\\Scanner->scanFile()\\n#12 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Updater.php(124): OC\\\\Files\\\\Cache\\\\Scanner->scan()\\n#13 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(336): OC\\\\Files\\\\Cache\\\\Updater->update()\\n#14 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1241): OC\\\\Files\\\\View->writeUpdate()\\n#15 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(752): OC\\\\Files\\\\View->basicOperation()\\n#16 \\\/var\\\/www\\\/owncloud\\\/lib\\\/public\\\/Events\\\/EventEmitterTrait.php(50): OC\\\\Files\\\\View->OC\\\\Files\\\\{closure}(*** sensitive parameters replaced ***)\\n#17 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(754): OC\\\\Files\\\\View->emittingCall()\\n#18 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1029): OC\\\\Files\\\\View->file_put_contents()\\n#19 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(865): OC\\\\Preview->storePreview()\\n#20 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1145): OC\\\\Preview->resizeAndStore()\\n#21 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(738): OC\\\\Preview->generatePreview()\\n#22 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Node\\\/File.php(170): OC\\\\Preview->getPreview()\\n#23 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Files\\\/PreviewPlugin.php(115): OC\\\\Files\\\\Node\\\\File->getThumbnail()\\n#24 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/event\\\/lib\\\/WildcardEmitterTrait.php(89): OCA\\\\DAV\\\\Files\\\\PreviewPlugin->httpGet()\\n#25 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(472): Sabre\\\\DAV\\\\Server->emit()\\n#26 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(253): Sabre\\\\DAV\\\\Server->invokeMethod()\\n#27 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Server.php(348): Sabre\\\\DAV\\\\Server->start()\\n#28 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(31): OCA\\\\DAV\\\\Server->exec()\\n#29 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#30 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Driver\\\/PDO\\\/Exception.php\",\"Line\":18}"}
{"reqId":"ZR-Q0qqQMVS0Y4@IZ2Td3AAAAAM","level":4,"time":"2023-10-06T09:19:02+00:00","remoteAddr":"46.114.212.72","user":"admin","app":"webdav","method":"GET","url":"\/remote.php\/dav\/files\/admin\/Photos\/10\/randimg_100x106a3344x2543.png?c=cd81fb1e8b41b749571674f7f6e616d6&x=32&y=32&forceIcon=0&preview=1","message":"Caused by: {\"Exception\":\"PDOException\",\"Message\":\"SQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction\",\"Code\":\"HY000\",\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Driver\\\/PDOStatement.php(117): PDOStatement->execute()\\n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(1527): Doctrine\\\\DBAL\\\\Driver\\\\PDOStatement->execute()\\n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(238): Doctrine\\\\DBAL\\\\Connection->executeStatement()\\n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Query\\\/QueryBuilder.php(216): OC\\\\DB\\\\Connection->executeStatement()\\n#4 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/QueryBuilder\\\/QueryBuilder.php(141): Doctrine\\\\DBAL\\\\Query\\\\QueryBuilder->execute()\\n#5 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Adapter.php(201): OC\\\\DB\\\\QueryBuilder\\\\QueryBuilder->execute()\\n#6 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(291): OC\\\\DB\\\\Adapter->upsert()\\n#7 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(328): OC\\\\DB\\\\Connection->upsert()\\n#8 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(281): OC\\\\Files\\\\Cache\\\\Cache->insert()\\n#9 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(281): OC\\\\Files\\\\Cache\\\\Cache->put()\\n#10 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(218): OC\\\\Files\\\\Cache\\\\Scanner->addToCache()\\n#11 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(326): OC\\\\Files\\\\Cache\\\\Scanner->scanFile()\\n#12 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Updater.php(124): OC\\\\Files\\\\Cache\\\\Scanner->scan()\\n#13 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(336): OC\\\\Files\\\\Cache\\\\Updater->update()\\n#14 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1241): OC\\\\Files\\\\View->writeUpdate()\\n#15 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(752): OC\\\\Files\\\\View->basicOperation()\\n#16 \\\/var\\\/www\\\/owncloud\\\/lib\\\/public\\\/Events\\\/EventEmitterTrait.php(50): OC\\\\Files\\\\View->OC\\\\Files\\\\{closure}(*** sensitive parameters replaced ***)\\n#17 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(754): OC\\\\Files\\\\View->emittingCall()\\n#18 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1029): OC\\\\Files\\\\View->file_put_contents()\\n#19 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(865): OC\\\\Preview->storePreview()\\n#20 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1145): OC\\\\Preview->resizeAndStore()\\n#21 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(738): OC\\\\Preview->generatePreview()\\n#22 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Node\\\/File.php(170): OC\\\\Preview->getPreview()\\n#23 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Files\\\/PreviewPlugin.php(115): OC\\\\Files\\\\Node\\\\File->getThumbnail()\\n#24 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/event\\\/lib\\\/WildcardEmitterTrait.php(89): OCA\\\\DAV\\\\Files\\\\PreviewPlugin->httpGet()\\n#25 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(472): Sabre\\\\DAV\\\\Server->emit()\\n#26 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(253): Sabre\\\\DAV\\\\Server->invokeMethod()\\n#27 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Server.php(348): Sabre\\\\DAV\\\\Server->start()\\n#28 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(31): OCA\\\\DAV\\\\Server->exec()\\n#29 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#30 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Driver\\\/PDOStatement.php\",\"Line\":117}"}
{"reqId":"mtODU9ZvA8td2yZJqhDp","level":1,"time":"2023-10-06T09:20:02+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"--","url":"--","message":"1 orphaned previews deleted"}
{"reqId":"mtODU9ZvA8td2yZJqhDp","level":1,"time":"2023-10-06T09:20:02+00:00","remoteAddr":"","user":"--","app":"cron","method":"--","url":"--","message":"Invalidating tokens older than 2023-10-06T09:00:02+00:00"}
{"reqId":"ZR-RVEcjfUmGKylBd6ToogAAAAY","level":4,"time":"2023-10-06T09:21:12+00:00","remoteAddr":"46.114.212.72","user":"admin","app":"webdav","method":"GET","url":"\/remote.php\/dav\/files\/admin\/Photos\/10\/randimg_100x195a3218x3899.png?c=3ae25ea83a01c52cdc18ff0b0e3dc146&x=32&y=32&forceIcon=0&preview=1","message":"Exception: HTTP\/1.1 400 An exception occurred while executing 'INSERT INTO `oc_filecache` (`mimepart`, `mimetype`, `mtime`, `size`, `etag`, `storage_mtime`, `permissions`, `checksum`, `parent`, `path_hash`, `path`, `name`, `storage`) VALUES(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' with params [\"5\", \"10\", 1696584021, 39531, \"38a9152a918869cbf52bf9cfe20485bf\", 1696584021, 27, \"SHA1:4bd7dc103691805fc816e3f6989949661348ac40 MD5:ca41df66f928f465096246c603572211 ADLER32:3668e01c\", 79043, \"44fc4848df136a4ef0f101d915eec9e0\", \"thumbnails\\\/5040\\\/100-195-max.png\", \"100-195-max.png\", 4]:\n\nSQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction: {\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\BadRequest\",\"Message\":\"An exception occurred while executing 'INSERT INTO `oc_filecache` (`mimepart`, `mimetype`, `mtime`, `size`, `etag`, `storage_mtime`, `permissions`, `checksum`, `parent`, `path_hash`, `path`, `name`, `storage`) VALUES(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' with params [\\\"5\\\", \\\"10\\\", 1696584021, 39531, \\\"38a9152a918869cbf52bf9cfe20485bf\\\", 1696584021, 27, \\\"SHA1:4bd7dc103691805fc816e3f6989949661348ac40 MD5:ca41df66f928f465096246c603572211 ADLER32:3668e01c\\\", 79043, \\\"44fc4848df136a4ef0f101d915eec9e0\\\", \\\"thumbnails\\\\\\\/5040\\\\\\\/100-195-max.png\\\", \\\"100-195-max.png\\\", 4]:\\n\\nSQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/event\\\/lib\\\/WildcardEmitterTrait.php(89): OCA\\\\DAV\\\\Files\\\\PreviewPlugin->httpGet()\\n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(472): Sabre\\\\DAV\\\\Server->emit()\\n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(253): Sabre\\\\DAV\\\\Server->invokeMethod()\\n#3 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Server.php(348): Sabre\\\\DAV\\\\Server->start()\\n#4 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(31): OCA\\\\DAV\\\\Server->exec()\\n#5 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#6 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Files\\\/PreviewPlugin.php\",\"Line\":156}"}
{"reqId":"ZR-RVEcjfUmGKylBd6ToogAAAAY","level":4,"time":"2023-10-06T09:21:12+00:00","remoteAddr":"46.114.212.72","user":"admin","app":"webdav","method":"GET","url":"\/remote.php\/dav\/files\/admin\/Photos\/10\/randimg_100x195a3218x3899.png?c=3ae25ea83a01c52cdc18ff0b0e3dc146&x=32&y=32&forceIcon=0&preview=1","message":"Caused by: {\"Exception\":\"Doctrine\\\\DBAL\\\\Exception\\\\LockWaitTimeoutException\",\"Message\":\"An exception occurred while executing 'INSERT INTO `oc_filecache` (`mimepart`, `mimetype`, `mtime`, `size`, `etag`, `storage_mtime`, `permissions`, `checksum`, `parent`, `path_hash`, `path`, `name`, `storage`) VALUES(?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)' with params [\\\"5\\\", \\\"10\\\", 1696584021, 39531, \\\"38a9152a918869cbf52bf9cfe20485bf\\\", 1696584021, 27, \\\"SHA1:4bd7dc103691805fc816e3f6989949661348ac40 MD5:ca41df66f928f465096246c603572211 ADLER32:3668e01c\\\", 79043, \\\"44fc4848df136a4ef0f101d915eec9e0\\\", \\\"thumbnails\\\\\\\/5040\\\\\\\/100-195-max.png\\\", \\\"100-195-max.png\\\", 4]:\\n\\nSQLSTATE[HY000]: General error: 1205 Lock wait timeout exceeded; try restarting transaction\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/DBALException.php(182): Doctrine\\\\DBAL\\\\Driver\\\\AbstractMySQLDriver->convertException()\\n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/DBALException.php(159): Doctrine\\\\DBAL\\\\DBALException::wrapException()\\n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(2226): Doctrine\\\\DBAL\\\\DBALException::driverExceptionDuringQuery()\\n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(1538): Doctrine\\\\DBAL\\\\Connection->handleExceptionDuringQuery()\\n#4 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(238): Doctrine\\\\DBAL\\\\Connection->executeStatement()\\n#5 \\\/var\\\/www\\\/owncloud\\\/lib\\\/composer\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Query\\\/QueryBuilder.php(216): OC\\\\DB\\\\Connection->executeStatement()\\n#6 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/QueryBuilder\\\/QueryBuilder.php(141): Doctrine\\\\DBAL\\\\Query\\\\QueryBuilder->execute()\\n#7 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Adapter.php(201): OC\\\\DB\\\\QueryBuilder\\\\QueryBuilder->execute()\\n#8 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/DB\\\/Connection.php(291): OC\\\\DB\\\\Adapter->upsert()\\n#9 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(328): OC\\\\DB\\\\Connection->upsert()\\n#10 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(281): OC\\\\Files\\\\Cache\\\\Cache->insert()\\n#11 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(281): OC\\\\Files\\\\Cache\\\\Cache->put()\\n#12 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(218): OC\\\\Files\\\\Cache\\\\Scanner->addToCache()\\n#13 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Scanner.php(326): OC\\\\Files\\\\Cache\\\\Scanner->scanFile()\\n#14 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Updater.php(124): OC\\\\Files\\\\Cache\\\\Scanner->scan()\\n#15 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(336): OC\\\\Files\\\\Cache\\\\Updater->update()\\n#16 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1241): OC\\\\Files\\\\View->writeUpdate()\\n#17 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(752): OC\\\\Files\\\\View->basicOperation()\\n#18 \\\/var\\\/www\\\/owncloud\\\/lib\\\/public\\\/Events\\\/EventEmitterTrait.php(50): OC\\\\Files\\\\View->OC\\\\Files\\\\{closure}(*** sensitive parameters replaced ***)\\n#19 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(754): OC\\\\Files\\\\View->emittingCall()\\n#20 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Preview.php(1190): OC\\\\Files\\\\View->file_put_contents()\\n#21 \\\/var\\\/www\\\/owncloud\\\/l

jnweiger avatar Oct 06 '23 10:10 jnweiger

we marked gallery as dead years ago ..... it needs love which it does not get .... not much we can do here ...

file scan alone in this scenario (without using gallery) should no cause such an issue ....

DeepDiver1975 avatar Oct 06 '23 10:10 DeepDiver1975

ah, that is good news (not for gallery, but for my scenario). Thanks! Will try to reproduce without gallery. :innocent:

jnweiger avatar Oct 06 '23 10:10 jnweiger

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 10 days if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Apr 04 '24 01:04 github-actions[bot]

This issue has been automatically closed.

github-actions[bot] avatar Apr 14 '24 01:04 github-actions[bot]