desktop icon indicating copy to clipboard operation
desktop copied to clipboard

Published 20 hours ago • verified publisher icon nextcloud

Windows and Linux (AppImage) clients 3.4.1 Freezing When Uploading Files

Open appliedbarrel opened this issue 2 years ago • 56 comments

How to use GitHub

  • Please use the 👍 reaction to show that you are affected by the same issue.
  • Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
  • Subscribe to receive notifications on status change and new comments.

Expected behaviour

Client should upload files to server and notify the user of conflicts, server issues, or other errors with the upload.

Actual behaviour

Client freezes when trying to upload a file. Folder sync connections which don't have changes work fine. Downloads from the server also work. Pausing folders which have pending uploads prevents the client from freezing, but the client still freezes when resuming. Cannot reproduce this problem on version 3.3.6 of the client.

Steps to reproduce

  1. Start client version 3.4.1
  2. Resume sync on one or more folders which have upload jobs
  3. Observe client beginning upload and progress bar moving
  4. Client freezes at the end of the upload
  5. Client program is completely unresponsive, has high CPU usage, and must be killed

Client configuration

Client version: 3.4.1

Operating system: Kubuntu 21.10

OS language: en-US

Qt version used by client package: ubuntu-5.13.0-22-generic

Client package: Nextcloud-3.4.1-x86_64.AppImage from this Github repo

Installation path of client: /home/[username] /Applications/Nextcloud-3.4.1-x86_64_5cbe3362585cfaace861289d8773450b.AppImage

Server configuration

Nextcloud version: 23

Storage backend (external storage): No external storage, Filesystem: ext4

Logs

Please use Gist (https://gist.github.com/) or a similar code paster for longer logs.

  1. Client logfile: I won't upload a debug archive as it does not obfuscate sensitive information.

Here is the final 10 lines of the log produced by the client (GIthub Gist).

The final line of the logs is usually the same type of message:

[ info nextcloud.sync.networkjob /home/user/src/libsync/abstractnetworkjob.cpp:361 ]: OCC::PutMultiFileJob created for "https://[mywebsite.url]" + "" "OCC::BulkPropagatorJob"

Judging by other log messages, it looks like the empty string above "" is where a path should go. I don't know enough to know whether this is useful information or not.

There was one instance (could not reproduce) where the above line was followed by:

[ info nextcloud.sync.propagator.root.directory /home/user/src/libsync/owncloudpropagator.cpp:1214 ]: scheduleSelfOrChild OCC::PropagatorJob::Running pending uploads 0 subjobs state OCC::PropagatorJob::Running

  1. Web server error log (formatted) It spits this error out each time:

[webdav] Fatal: Unknown error while seeking content POST /remote.php/dav/bulk from [IP ADDRESS] by [nextcloud username] at 2021-12-22T16:13:18+00:00

  1. Server logfile: nextcloud log (data/nextcloud.log): I can possibly provide this in the future if necessary.

appliedbarrel avatar Dec 22 '21 17:12 appliedbarrel

I can reproduce this on Windows, too: 3.4.1 is affected, 3.3.6 is fine. I'm also seeing the Unknown error while seeking content log message on the server, but it does not appear every time when the client freezes, so it might be unrelated.

fefrei avatar Dec 23 '21 19:12 fefrei

@mgallien Did you have anything similar on Linux?

UPDATE: Might be something related to Bulk Upload. Last log line: 2021-12-22 16:03:12:037 [ info nextcloud.sync.networkjob /home/user/src/libsync/abstractnetworkjob.cpp:361 ]: OCC::PutMultiFileJob created for "https://cloud.[mywebsite.url]" + "" "OCC::BulkPropagatorJob"

allexzander avatar Dec 24 '21 13:12 allexzander

Desktop logs might help solve this. You can upload them here https://cloud.nextcloud.com/s/DNQPFm7NXtQZtdS in case you prefer not to make them publicly available.

allexzander avatar Dec 28 '21 08:12 allexzander

I can reproduce this on Windows, too: 3.4.1 is affected, 3.3.6 is fine. I'm also seeing the Unknown error while seeking content log message on the server, but it does not appear every time when the client freezes, so it might be unrelated.

Looks very similar to #4077

allexzander avatar Dec 28 '21 08:12 allexzander

I have the same problem with the build from Archlinux. Same message in the log file and not indicators what the problem might be. I uploaded the last few lines of the log file. Those with the unchanged files before, which made no problem and the transaction when the client freezes.

lars-becker avatar Dec 28 '21 15:12 lars-becker

@allexzander I found a corresponding log in the php-fpm journal:

Dez 28 17:09:43 jarvis Nextcloud[21403]: {"reqId":"0hgEj8EYAmtZMK2RzNhl","level":4,"time":"2021-12-28T17:09:43+01:00","remoteAddr":"IP_ADDRESS_REDACTED","user":"lars","app":"webdav","method":"POST","url":"/remote.php/dav/bulk","message":"{\"Exce
ption\":\"Sabre\\\\DAV\\\\Exception\",\"Message\":\"Unknown error while seeking content\",\"Code\":500,\"Trace\":[{\"file\":\"/var/www/nextcloud/apps/dav/lib/BulkUpload/MultipartRequestParser.php\",\"line\":129,\"function\":\"isAt\",\"cl
ass\":\"OCA\\\\DAV\\\\BulkUpload\\\\MultipartRequestParser\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/apps/dav/lib/BulkUpload/BulkUploadPlugin.php\",\"line\":69,\"function\":\"isAtLastBoundary\",\"class\":\"OCA\\\\DAV\\\\BulkUploa
d\\\\MultipartRequestParser\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php\",\"line\":89,\"function\":\"httpPost\",\"class\":\"OCA\\\\DAV\\\\BulkUpload\\\\BulkUploadPlugin\",\"type\":\
"->\"},{\"file\":\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\",\"line\":472,\"function\":\"emit\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\"
,\"line\":253,\"function\":\"invokeMethod\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\",\"line\":321,\"function\":\"start\",\"class\":\"Sabre\\\\DAV\\\\Serv
er\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/apps/dav/lib/Server.php\",\"line\":339,\"function\":\"exec\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php\",\"lin
e\":35,\"function\":\"exec\",\"class\":\"OCA\\\\DAV\\\\Server\",\"type\":\"->\"},{\"file\":\"/var/www/nextcloud/remote.php\",\"line\":166,\"args\":[\"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php\"],\"function\":\"require_once\"}],\"
File\":\"/var/www/nextcloud/apps/dav/lib/BulkUpload/MultipartRequestParser.php\",\"Line\":111,\"CustomMessage\":\"--\"}","userAgent":"Mozilla/5.0 (Linux) mirall/3.4.1git (Nextcloud, arch-5.15.11-arch2-1 ClientArchitecture: x86_64 OsArchi
tecture: x86_64)","version":"23.0.0.10"}

Looks like a bug on the server side and missing error handling for this situation on the client side.

lars-becker avatar Dec 28 '21 16:12 lars-becker

I managed to capture a client log for such a freeze. I uploaded a redacted version of the log to link provided by @allexzander (20211228_1711_owncloud.redacted.log.zip), the last few lines of which I reproduced here:

2021-12-28 17:13:15:291 [ info nextcloud.sync.propagator.root.directory C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:1214 ]:	scheduleSelfOrChild OCC::PropagatorJob::Running pending uploads 2 subjobs state OCC::PropagatorJob::Running
2021-12-28 17:13:15:291 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.h:212 ]:	Starting CSyncEnums::CSYNC_INSTRUCTION_IGNORE propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d7d00)
2021-12-28 17:13:15:291 [ warning nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:281 ]:	Could not complete propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d7d00) with status OCC::SyncFileItem::FileIgnored and error: "File is listed on the ignore list."
2021-12-28 17:13:15:291 [ debug nextcloud.sync.statustracker C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\syncfilestatustracker.cpp:274 ]	[ OCC::SyncFileStatusTracker::slotItemCompleted ]:	Item completed "■■■■■■■■■■" OCC::SyncFileItem::FileIgnored CSyncEnums::CSYNC_INSTRUCTION_IGNORE
2021-12-28 17:13:15:291 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:559 ]:	Item  "■■■■■■■■■■"  retrieved resulted in  "File is listed on the ignore list."
2021-12-28 17:13:15:291 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:536 ]:	Item  "■■■■■■■■■■"  retrieved resulted in error  "File is listed on the ignore list."
2021-12-28 17:13:15:291 [ info nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\activitylistmodel.cpp:371 ]:	First checking for duplicates then add file to the notification list of ignored files:  "■■■■■■■■■■"
2021-12-28 17:13:15:295 [ info nextcloud.sync.propagator.root.directory C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:1214 ]:	scheduleSelfOrChild OCC::PropagatorJob::Running pending uploads 2 subjobs state OCC::PropagatorJob::Running
2021-12-28 17:13:15:295 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.h:212 ]:	Starting CSyncEnums::CSYNC_INSTRUCTION_IGNORE propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d82a0)
2021-12-28 17:13:15:295 [ warning nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:281 ]:	Could not complete propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d82a0) with status OCC::SyncFileItem::FileIgnored and error: "File is listed on the ignore list."
2021-12-28 17:13:15:295 [ debug nextcloud.sync.statustracker C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\syncfilestatustracker.cpp:274 ]	[ OCC::SyncFileStatusTracker::slotItemCompleted ]:	Item completed "■■■■■■■■■■" OCC::SyncFileItem::FileIgnored CSyncEnums::CSYNC_INSTRUCTION_IGNORE
2021-12-28 17:13:15:295 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:559 ]:	Item  "■■■■■■■■■■"  retrieved resulted in  "File is listed on the ignore list."
2021-12-28 17:13:15:295 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:536 ]:	Item  "■■■■■■■■■■"  retrieved resulted in error  "File is listed on the ignore list."
2021-12-28 17:13:15:295 [ info nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\activitylistmodel.cpp:371 ]:	First checking for duplicates then add file to the notification list of ignored files:  "■■■■■■■■■■"
2021-12-28 17:13:15:298 [ info nextcloud.sync.propagator.root.directory C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:1214 ]:	scheduleSelfOrChild OCC::PropagatorJob::Running pending uploads 2 subjobs state OCC::PropagatorJob::Running
2021-12-28 17:13:15:298 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.h:212 ]:	Starting CSyncEnums::CSYNC_INSTRUCTION_IGNORE propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d8890)
2021-12-28 17:13:15:298 [ warning nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:281 ]:	Could not complete propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d8890) with status OCC::SyncFileItem::FileIgnored and error: "File is listed on the ignore list."
2021-12-28 17:13:15:298 [ debug nextcloud.sync.statustracker C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\syncfilestatustracker.cpp:274 ]	[ OCC::SyncFileStatusTracker::slotItemCompleted ]:	Item completed "■■■■■■■■■■" OCC::SyncFileItem::FileIgnored CSyncEnums::CSYNC_INSTRUCTION_IGNORE
2021-12-28 17:13:15:298 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:559 ]:	Item  "■■■■■■■■■■"  retrieved resulted in  "File is listed on the ignore list."
2021-12-28 17:13:15:298 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:536 ]:	Item  "■■■■■■■■■■"  retrieved resulted in error  "File is listed on the ignore list."
2021-12-28 17:13:15:298 [ info nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\activitylistmodel.cpp:371 ]:	First checking for duplicates then add file to the notification list of ignored files:  "■■■■■■■■■■"
2021-12-28 17:13:15:301 [ info nextcloud.sync.propagator.root.directory C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:1214 ]:	scheduleSelfOrChild OCC::PropagatorJob::Running pending uploads 2 subjobs state OCC::PropagatorJob::Running
2021-12-28 17:13:15:301 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.h:212 ]:	Starting CSyncEnums::CSYNC_INSTRUCTION_IGNORE propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d8ac0)
2021-12-28 17:13:15:301 [ warning nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:281 ]:	Could not complete propagation of "■■■■■■■■■■" by OCC::PropagateIgnoreJob(0x1ad7a6d8ac0) with status OCC::SyncFileItem::FileIgnored and error: "File is listed on the ignore list."
2021-12-28 17:13:15:301 [ debug nextcloud.sync.statustracker C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\syncfilestatustracker.cpp:274 ]	[ OCC::SyncFileStatusTracker::slotItemCompleted ]:	Item completed "■■■■■■■■■■" OCC::SyncFileItem::FileIgnored CSyncEnums::CSYNC_INSTRUCTION_IGNORE
2021-12-28 17:13:15:301 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:559 ]:	Item  "■■■■■■■■■■"  retrieved resulted in  "File is listed on the ignore list."
2021-12-28 17:13:15:301 [ warning nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\usermodel.cpp:536 ]:	Item  "■■■■■■■■■■"  retrieved resulted in error  "File is listed on the ignore list."
2021-12-28 17:13:15:301 [ info nextcloud.gui.activity C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\gui\tray\activitylistmodel.cpp:371 ]:	First checking for duplicates then add file to the notification list of ignored files:  "■■■■■■■■■■"
2021-12-28 17:13:15:301 [ info nextcloud.sync.propagator.root.directory C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:1238 ]:	OCC::SyncFileItem::Success slotSubJobsFinished OCC::PropagatorJob::Running pending uploads 2 subjobs state OCC::PropagatorJob::Finished
2021-12-28 17:13:15:301 [ info nextcloud.sync.propagator C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\owncloudpropagator.cpp:1270 ]:	PropagateRootDirectory::scheduleDelayedJobs
2021-12-28 17:13:15:301 [ info nextcloud.sync.checksums C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\checksums.cpp:230 ]:	Computing "MD5" checksum of "■■■■■■■■■■" in a thread
2021-12-28 17:13:15:301 [ info nextcloud.sync.checksums C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\checksums.cpp:230 ]:	Computing "MD5" checksum of "■■■■■■■■■■" in a thread
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 1 "■■■■■■■■■■"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 2 0
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 3 0
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 4 0
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 5 49156
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 6 1616699454
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:151 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 7 "MD5:50cf6b1f0de5932e99cdea807c24177f"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\ownsql.cpp:295 ]	[ OCC::SqlQuery::exec ]:	SQL exec "INSERT OR REPLACE INTO uploadinfo (path, chunk, transferid, errorcount, size, modtime, contentChecksum) VALUES ( ?1 , ?2, ?3 , ?4 ,  ?5, ?6 , ?7 )"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\ownsql.cpp:328 ]	[ OCC::SqlQuery::exec ]:	Last exec affected 1 rows.
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\syncjournaldb.cpp:2439 ]	[ OCC::SyncJournalDb::commitInternal ]:	Transaction commit "Upload info" and starting new transaction
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:151 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 1 "■■■■■■■■■■"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\ownsql.cpp:295 ]	[ OCC::SqlQuery::exec ]:	SQL exec "SELECT baseFileId, baseModtime, baseEtag, basePath FROM conflicts WHERE path=?1;"
2021-12-28 17:13:15:303 [ info nextcloud.sync.propagator.bulkupload C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\bulkpropagatorjob.cpp:183 ]:	"■■■■■■■■■■" transmission checksum "50cf6b1f0de5932e99cdea807c24177f" "■■■■■■■■■■"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 1 "■■■■■■■■■■"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 2 0
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 3 0
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 4 0
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 5 24413
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:145 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 6 1616699725
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:151 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 7 "MD5:a72fc90754d894d131eaa4c930c09593"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\ownsql.cpp:295 ]	[ OCC::SqlQuery::exec ]:	SQL exec "INSERT OR REPLACE INTO uploadinfo (path, chunk, transferid, errorcount, size, modtime, contentChecksum) VALUES ( ?1 , ?2, ?3 , ?4 ,  ?5, ?6 , ?7 )"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\ownsql.cpp:328 ]	[ OCC::SqlQuery::exec ]:	Last exec affected 1 rows.
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\syncjournaldb.cpp:2439 ]	[ OCC::SyncJournalDb::commitInternal ]:	Transaction commit "Upload info" and starting new transaction
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common/ownsql.h:151 ]	[ OCC::SqlQuery::bindValue ]:	SQL bind 1 "■■■■■■■■■■"
2021-12-28 17:13:15:303 [ debug nextcloud.sync.database.sql C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\common\ownsql.cpp:295 ]	[ OCC::SqlQuery::exec ]:	SQL exec "SELECT baseFileId, baseModtime, baseEtag, basePath FROM conflicts WHERE path=?1;"
2021-12-28 17:13:15:303 [ info nextcloud.sync.propagator.bulkupload C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\bulkpropagatorjob.cpp:183 ]:	"■■■■■■■■■■" transmission checksum "a72fc90754d894d131eaa4c930c09593" "■■■■■■■■■■"
2021-12-28 17:13:15:304 [ info nextcloud.sync.accessmanager C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\accessmanager.cpp:78 ]:	4 "" "https://cloud.example.invalid/remote.php/dav/bulk" has X-Request-ID "■■■■■■■■■■"
2021-12-28 17:13:15:304 [ debug nextcloud.sync.cookiejar C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\cookiejar.cpp:90 ]	[ OCC::CookieJar::cookiesForUrl ]:	QUrl("https://cloud.example.invalid/remote.php/dav/bulk") requests: (QNetworkCookie("__Host-nc_sameSiteCookielax=true; secure; HttpOnly; expires=Fri, 31-Dec-2100 23:59:59 GMT; domain=cloud.example.invalid; path=/"), QNetworkCookie("__Host-nc_sameSiteCookiestrict=true; secure; HttpOnly; expires=Fri, 31-Dec-2100 23:59:59 GMT; domain=cloud.example.invalid; path=/"), QNetworkCookie("oc_sessionPassphrase=■■■■■■■■■■; secure; HttpOnly; domain=cloud.example.invalid; path=/"), QNetworkCookie("■■■■■■■■■■; secure; HttpOnly; domain=cloud.example.invalid; path=/"))
2021-12-28 17:13:15:304 [ info nextcloud.sync.networkjob C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\abstractnetworkjob.cpp:361 ]:	OCC::PutMultiFileJob created for "https://cloud.example.invalid" + "" "OCC::BulkPropagatorJob"

What happened before is that I upgraded the client, started it, and it started to sync the folder in question. With no freeze occurring within about 30 minutes, I paused and restarted the sync, which almost immediately resulted in the freeze.

fefrei avatar Dec 28 '21 16:12 fefrei

This also happens to me with 3.4.1 on windows. Rolling back to 3.3.6 fixes it. Same symptoms as above: the last client log file line before it hangs is: 2021-12-29 12:59:43:090 [ info nextcloud.sync.networkjob C:\Users\sysadmin\AppData\Local\Temp\2\windows-8634\client-building\desktop\src\libsync\abstractnetworkjob.cpp:361 ]: OCC::PutMultiFileJob created for "https://my.nextcloud.example.com" + "" "OCC::BulkPropagatorJob"

And the server logs show "Unknown error while seeking content"

Lord-Nightmare avatar Dec 29 '21 21:12 Lord-Nightmare

Confirmed with Linux version 5.10.0-8-amd64 ([email protected]) (gcc-10 (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2) #1 SMP Debian 5.10.46-3 (2021-07-28)

Client 3.3.6 does not show these symptoms.

Quix0r avatar Dec 30 '21 18:12 Quix0r

same thing happened to me on Win10 with 3.4.1 downgrading to 3.3.6 64bit resolved it apparently.

mael2 avatar Jan 02 '22 17:01 mael2

I'm also affected here. Server is 23.0.0, using Windows client 3.4.1. Client freezes a few seconds after starting, waited 30+ minutes and did not resume. Tried deleting .sync.db files, but the error came back after sync resumed.

Downgrading client to 3.3.6 makes the problem go away.

Entry in Server logs:

[webdav] Fatal: Unknown error while seeking content

POST /remote.php/dav/bulk
from 172.19.0.11 by philip at 2022-01-07T14:46:05+00:00

{"reqId":"WKHg0G6RNgiuTb0lKM3O","level":4,"time":"2022-01-07T14:46:05+00:00","remoteAddr":"172.19.0.11","user":"philip","app":"webdav","method":"POST","url":"/remote.php/dav/bulk","message":"Unknown error while seeking content","userAgent":"Mozilla/5.0 (Windows) mirall/3.4.1stable-Win64 (build 20211221) (Nextcloud, windows-10.0.19044 ClientArchitecture: x86_64 OsArchitecture: x86_64)","version":"23.0.0.10","exception":{"Exception":"Sabre\\DAV\\Exception","Message":"Unknown error while seeking content","Code":500,"Trace":[{"file":"/var/www/html/apps/dav/lib/BulkUpload/MultipartRequestParser.php","line":129,"function":"isAt","class":"OCA\\DAV\\BulkUpload\\MultipartRequestParser","type":"->","args":["--boundary_.oOo._Q1JHJPZzZXyeHgVSSeAKtc8EVuC12zVL--\r\n"]},{"file":"/var/www/html/apps/dav/lib/BulkUpload/BulkUploadPlugin.php","line":69,"function":"isAtLastBoundary","class":"OCA\\DAV\\BulkUpload\\MultipartRequestParser","type":"->","args":[]},{"file":"/var/www/html/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"httpPost","class":"OCA\\DAV\\BulkUpload\\BulkUploadPlugin","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php","line":472,"function":"emit","class":"Sabre\\DAV\\Server","type":"->","args":["method:POST",[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php","line":253,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/html/3rdparty/sabre/dav/lib/DAV/Server.php","line":321,"function":"start","class":"Sabre\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/html/apps/dav/lib/Server.php","line":339,"function":"exec","class":"Sabre\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/html/apps/dav/appinfo/v2/remote.php","line":35,"function":"exec","class":"OCA\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/html/remote.php","line":166,"args":["/var/www/html/apps/dav/appinfo/v2/remote.php"],"function":"require_once"}],"File":"/var/www/html/apps/dav/lib/BulkUpload/MultipartRequestParser.php","Line":111,"CustomMessage":"--"},"id":"61d8522d3155f"}

bananer avatar Jan 07 '22 15:01 bananer

It doesn't freeze permanently for me (hangs for a few seconds at a time). 100% CPU usage on a single core during bulk upload. It manages to upload 100 files every 30s-1m, which is slower than 3.3.6 was with one request per file.

Derkades avatar Jan 08 '22 11:01 Derkades

I have also had the issue on Windows 10, and downgrading to 3.3.6 fixed it on there too.

It doesn't freeze permanently for me (hangs for a few seconds at a time). 100% CPU usage on a single core during bulk upload. It manages to upload 100 files every 30s-1m, which is slower than 3.3.6 was with one request per file.

I've also noticed that it uses 100% CPU on a single core on both Windows and my Linux system. It never actually completed on either system (after leaving it in background for over an hour), but I was only uploading one or two file changes at a time.

appliedbarrel avatar Jan 08 '22 13:01 appliedbarrel

This is happening to me with the macOS client as well (version 3.4.1). File is not successfully uploaded; client hangs and must be killed.

willvousden avatar Jan 09 '22 14:01 willvousden

Could be related to https://github.com/nextcloud/desktop/issues/4141

allexzander avatar Jan 10 '22 10:01 allexzander

Confirmed here (Linux Manjaro Gnome). Also log files generated in ~/.config/Nextcloud/logs many, many GB in size.

Downgrading to the previous version (had to use AppImage) fixed the problem.

sigreer avatar Jan 11 '22 01:01 sigreer

same error log since the update to nextcloud 23.0.0, worked fine with nextcloud 21.0.6, using client 3.4.1. both clients and servers are on OpenBSD, so unrelated to appimage.

{
  "reqId": "7qEGZTcQeMdpw3QOctgu",
  "level": 4,
  "time": "2022-01-20T09:53:44+00:00",
  "remoteAddr": "10.246.200.35",
  "user": "landry",
  "app": "webdav",
  "method": "POST",
  "url": "/remote.php/dav/bulk",
  "message": "Unknown error while seeking content",
  "userAgent": "Mozilla/5.0 (OpenBSD) mirall/3.4.1git (Nextcloud, unknown-7.0 ClientArchitecture: x86_64 OsArchitecture: x86_64)",
  "version": "23.0.0.10",
  "exception": {
    "Exception": "Sabre\\DAV\\Exception",
    "Message": "Unknown error while seeking content",
    "Code": 500,
    "Trace": [
      {
        "file": "/nextcloud/apps/dav/lib/BulkUpload/MultipartRequestParser.php",
        "line": 129,
        "function": "isAt",
        "class": "OCA\\DAV\\BulkUpload\\MultipartRequestParser",
        "type": "->"
      },
      {
        "file": "/nextcloud/apps/dav/lib/BulkUpload/BulkUploadPlugin.php",
        "line": 69,
        "function": "isAtLastBoundary",
        "class": "OCA\\DAV\\BulkUpload\\MultipartRequestParser",
        "type": "->"
      },
      {
        "file": "/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php",
        "line": 89,
        "function": "httpPost",
        "class": "OCA\\DAV\\BulkUpload\\BulkUploadPlugin",
        "type": "->"
      },
      {
        "file": "/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php",
        "line": 472,
        "function": "emit",
        "class": "Sabre\\DAV\\Server",
        "type": "->"
      },
      {
        "file": "/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php",
        "line": 253,
        "function": "invokeMethod",
        "class": "Sabre\\DAV\\Server",
        "type": "->"
      },
      {
        "file": "/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php",
        "line": 321,
        "function": "start",
        "class": "Sabre\\DAV\\Server",
        "type": "->"
      },
      {
        "file": "/nextcloud/apps/dav/lib/Server.php",
        "line": 339,
        "function": "exec",
        "class": "Sabre\\DAV\\Server",
        "type": "->"
      },
      {
        "file": "/nextcloud/apps/dav/appinfov2/remote.php",
        "line": 35,
        "function": "exec",
        "class": "OCA\\DAV\\Server",
        "type": "->"
      },
      {
        "file": "/nextcloud/remote.php",
        "line": 166,
        "args": [
          "/nextcloud/apps/dav/appinfo/v2/remote.php"
        ],
        "function": "require_once"
      }
    ],
    "File": "/nextcloud/apps/dav/lib/BulkUpload/MultipartRequestParser.php",
    "Line": 111,
    "CustomMessage": "--"
  }
}

landryb avatar Jan 20 '22 10:01 landryb

@landryb @bananer @lars-becker and others could you by any chance still reproduce the error and test a patched version ? I will take my chance at triggering it as I know it can happen but I do not yet know how to do it

mgallien avatar Jan 20 '22 14:01 mgallien

sure @mgallien i can take a patch and apply it to our openbsd port of the client locally and check if it 'solves' the issue :) but it also seems that's a serverside issue - eg the bulk upload feature in 23.0 has still some rough edges per nextcloud/server#29702 ?

landryb avatar Jan 20 '22 14:01 landryb

@mgallien fwiw for me on OpenBSD just doing 'touch' on a synchronized file (to force an upload) was enough to trigger the problem, but not on all files (eg some were properly synced). I'll check if i can gather more info from a client debug log, but i'll gladly take a patch to test.

landryb avatar Jan 20 '22 16:01 landryb

@landryb @bananer @lars-becker and others could you by any chance still reproduce the error and test a patched version ? I will take my chance at triggering it as I know it can happen but I do not yet know how to do it

Of course. Could take until the end of the next week, because my schedule is quite full until then, but if I can help to fix this annoying issue, I gladly will. Where can I find the patch or do you provide a build which I can use?

lars-becker avatar Jan 21 '22 01:01 lars-becker

@mgallien I can give it a try on macOS as well but I'm not able to find the new build

jcastro avatar Jan 21 '22 16:01 jcastro

same here one macos catalina and moterey for 4.1, everything is fine on 3.3.6.

bendschs avatar Jan 21 '22 17:01 bendschs

Confirmed, on Mint 20.3, desktop client version 4.1, distributions from both official AppImage published on Github and Aptitude package on Launchpad PPA appear to spin into infinite loop during certain synchronization operations. Version 3.3.6 works correctly.

Running against server 23.0.0 with no other problems.

brainchild0 avatar Jan 21 '22 18:01 brainchild0

Same issue here on Arch (across two independent OS environments - default nextcloud-client package). Not sure what aspects of hardware/software environment could be critical here, obviously, they're both btrfs based...

Happy to help trouble shoot, provide debug logs or anything if it helps.

b0ssi avatar Jan 25 '22 09:01 b0ssi

@mgallien: fwiw i know it's not the right fix, but i locally rebuilt 3.4.1 disabling bulk upload (eg returning false in Capabilities::bulkUpload() in src/libsync/capabilities.cpp and i've been able to push/pull/sync files from nextcloud 23.0.0 fine without issues.

landryb avatar Jan 27 '22 12:01 landryb

@mgallien: fwiw i know it's not the right fix, but i locally rebuilt 3.4.1 disabling bulk upload (eg returning false in Capabilities::bulkUpload() in src/libsync/capabilities.cpp and i've been able to push/pull/sync files from nextcloud 23.0.0 fine without issues.

Any chance you're able to provide that build for download?

valdearg avatar Jan 27 '22 15:01 valdearg

@mgallien: fwiw i know it's not the right fix, but i locally rebuilt 3.4.1 disabling bulk upload (eg returning false in Capabilities::bulkUpload() in src/libsync/capabilities.cpp and i've been able to push/pull/sync files from nextcloud 23.0.0 fine without issues.

Any chance you're able to provide that build for download?

sorry, that's an OpenBSD package for my own needs, but anyone using windows or linux should be easily able to do the same (eg change a line/patch, rebuild).

And i would rather advise against trying exotic builds provided by random people on github :)

landryb avatar Jan 27 '22 16:01 landryb

Couldn't it also be an option to disable bulk uploads in some server-side configuration or source file as a workaround? (I did not find any documentation on this, unfortunately.)

felix-walter avatar Jan 27 '22 16:01 felix-walter

Same problem, revert to 3.3.6 fix all problems. The problem is related with multipart bulk uploads

hufon avatar Jan 27 '22 19:01 hufon