rmfakecloud icon indicating copy to clipboard operation
rmfakecloud copied to clipboard

Unreliable Sync on 2.12.1.527

Open benneti opened this issue 2 years ago • 15 comments

Hi,

I just updated to 2.12.1.527 (and use the new sync protocoll because it was way more reliable on the version I used before 2.11.something). And now the sync does not work reliably anymore (at all), i.e. I tried to add 3 pdfs and only one popped up on the RM, then I deleted all three and the one that popped up just stays on the RM. On the server I do not see anything strange in the logs, but on the RM I get in log.txt:

Feb 11 11:06:34.879 Warning:    with body  "" (:0, )
Feb 11 11:06:34.972 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.972 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.972 Warning:    with body  "" (:0, )
Feb 11 11:06:34.973 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9XaW5zbG93X1BhbG0tRGVzZXJ0LmVwdWIuZXB1Yg==/metadata") (:0, )
Feb 11 11:06:34.973 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.974 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.977 Warning:    with body  "" (:0, )
Feb 11 11:06:34.977 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9XaW5zbG93X0phaHJlLWRlcy1KYWVnZXJzLmVwdWI=/metadata") (:0, )
Feb 11 11:06:34.978 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.978 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.978 Warning:    with body  "" (:0, )
Feb 11 11:06:34.978 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9XaW5zbG93X1dheS1Eb3duLW9uLXRoZS1IaWdoLUxvbmVseS5lcHViLmVwdWI=/metadata") (:0, )
Feb 11 11:06:34.978 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.979 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.979 Warning:    with body  "" (:0, )
Feb 11 11:06:34.979 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9Xb19zdGVja3N0X2R1X0Jlcm5hZGV0dGVfbm9kcm0uZXB1Yi5lcHVi/metadata") (:0, )
Feb 11 11:06:34.980 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.980 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.980 Warning:    with body  "" (:0, )
Feb 11 11:06:34.980 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9aaWVtbGljaF9iZXN0ZV9GZWluZGVfbm9kcm0uZXB1Yi5lcHVi/metadata") (:0, )
Feb 11 11:06:34.980 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.981 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.981 Warning:    with body  "" (:0, )
Feb 11 11:06:34.981 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9aRVJPXy1fU2llX3dpc3Nlbl93YXNfZHVfdHVzdF9ub2RybS5lcHViLmVwdWI=/metadata") (:0, )
Feb 11 11:06:34.981 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.981 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.981 Warning:    with body  "" (:0, )
Feb 11 11:06:34.982 Warning: Error on request  QUrl("https://internal.cloud.remarkable.com/integrations/v1/01146f3d-e196-4f60-9cf9-421b4571bad1/files/L2VCb29rU1ZFTi9ZYW5hZ2loYXJhX0Vpbi13ZW5pZy1MZWJlbi5lcHViLmVwdWI=/metadata") (:0, )
Feb 11 11:06:34.982 Warning:    with error  QNetworkReply::OperationNotImplementedError (:0, )
Feb 11 11:06:34.982 Warning:    with httpcode  501 (:0, )
Feb 11 11:06:34.982 Warning:    with body  "" (:0, )
Feb 11 11:07:31.878 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:07:31.881 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:10:18.676 Warning: Already have this address: QHostAddress("fd8a:6177:1645:43b6:ce4b:73ff:feb3:2cce") (:0, )
Feb 11 11:10:25.247 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:10:25.250 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:11:30.066 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:11:30.069 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:11:49.521 Warning: Already have this address: QHostAddress("fd8a:6177:1645:43b6:ce4b:73ff:feb3:2cce") (:0, )
Feb 11 11:12:34.784 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:12:34.787 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:13:40.283 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:13:40.285 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:14:45.550 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:14:45.555 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:15:26.728 Warning: Already have this address: QHostAddress("fd8a:6177:1645:43b6:ce4b:73ff:feb3:2cce") (:0, )
Feb 11 11:15:50.575 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:15:50.578 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:16:16.275 Warning: Already have this address: QHostAddress("fd8a:6177:1645:43b6:ce4b:73ff:feb3:2cce") (:0, )
Feb 11 11:16:55.482 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:16:55.485 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:18:06.461 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:18:06.466 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:19:10.126 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:19:10.131 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:20:13.995 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:20:13.998 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:21:17.544 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:21:17.547 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:22:57.894 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:22:57.899 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:24:02.304 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:24:02.306 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:24:14.829 Info: Scanning: true (:0, )
Feb 11 11:24:18.269 Info: Scanning: false (:0, )
Feb 11 11:25:07.172 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:25:07.175 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:25:08.416 Warning: Already have this address: QHostAddress("fd8a:6177:1645:43b6:ce4b:73ff:feb3:2cce") (:0, )
Feb 11 11:26:12.556 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:26:12.561 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:27:16.547 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )
Feb 11 11:27:16.553 Warning: Notification error:  QAbstractSocket::RemoteHostClosedError "The TLS/SSL connection has been closed" 1000 "" (:0, )

Also it seems that changes to documents made since the update don't appear in the webinterface's preview anymore.

benneti avatar Feb 11 '22 11:02 benneti

Hmm ok, maybe the problem is that the requested document is missing from the server. Also for some reason I have a document with empty name on the server... I'll retry with a clean account, maybe this will help. EDIT: didn't help

benneti avatar Feb 11 '22 12:02 benneti

there seem to be some reports concerning event the official servers, but I haven't investigated it yet

ddvk avatar Feb 14 '22 11:02 ddvk

Yeah no problem, for now I simply switched back to the old sync which works reliably (while being slightly slower). If there is anything I could help you with let me know.

benneti avatar Feb 14 '22 11:02 benneti

it seems that the the sync service is crashing, you can try it like this:

systemctl stop sync
 QT_LOGGING_RULES=*=true  sync --service

ddvk avatar Feb 15 '22 01:02 ddvk

I'm also having problems. Syncing seems to be stuck. One item says it's downloading even though it's not present on the server. A couple of others are uploading changes but not getting anywhere. Syncing is stuck. I also updated to the new software version.

I restarted rmfakecloud and my reMarkable. It didn't help.

Myridium avatar Feb 16 '22 11:02 Myridium

I ran this on the reMarkable:

systemctl stop sync
systemctl start sync

This caused the uploading documents to complete. But that one downloading document is stuck again. (Again, this document doesn't even exist on the server so it shouldn't be downloading.

I tried copying that document and deleting the original (including from trash). Then the syncing just gets stuck on the copy.

Is this issue affecting the official servers as well?

Myridium avatar Feb 16 '22 11:02 Myridium

the problem is that the sync is crashing, you can use the sync binary from the previous version e.g mount the other partition and just copy it over

rm.shared.tasktracker: cleaning SyncDownloadBlobJob(0xab9d70)
ASSERT: "bytesTotal >= bytes" in file /usr/src/debug/xochitl/override+gitAUTOINC+872f33abab-r0/git/src/sync/src/documentprogress.cpp, line 44
We crashed

ddvk avatar Feb 16 '22 11:02 ddvk

Yeah, looks like it is crashing. Device says "Syncing complete" and then systemctl status sync says:

[[0;1;31m●[[0m sync.service - reMarkable Document Sync
     Loaded: loaded (/lib/systemd/system/sync.service; enabled; vendor preset: enabled)
     Active: [[0;1;31mfailed[[0m (Result: exit-code) since Wed 2022-02-16 11:17:57 UTC; 2s ago
    Process: 451 ExecStart=/usr/bin/sync --service [[0;1;31m(code=exited, status=1/FAILURE)[[0m
   Main PID: 451 (code=exited, status=1/FAILURE)

Feb 16 11:17:57 reMarkable systemd[1]: sync.service: Scheduled restart job, restart counter is at 4.
Feb 16 11:17:57 reMarkable systemd[1]: Stopped reMarkable Document Sync.
Feb 16 11:17:57 reMarkable systemd[1]: [[0;1;38;5;185m[[0;1;39m[[0;1;38;5;185msync.service: Start request repeated too quickly.[[0m
Feb 16 11:17:57 reMarkable systemd[1]: [[0;1;38;5;185m[[0;1;39m[[0;1;38;5;185msync.service: Failed with result 'exit-code'.[[0m
Feb 16 11:17:57 reMarkable systemd[1]: [[0;1;31m[[0;1;39m[[0;1;31mFailed to start reMarkable Document Sync.[[0m

Sorry, what do you mean about mounting the other partition @ddvk ? Is rmfakecloud able to copy everything to the old format somehow?

Myridium avatar Feb 16 '22 11:02 Myridium

i mean on the device mount the other partition which has the previous version and use the old sync binary.

mmcblk2p2 or mmcblk2p3 depending on which is the active one

mkdir mnt
mount /dev/mmcblk2p$(fw_printenv -n fallback_partition) mnt
cp mnt/usr/bin/sync /usr/bin

ddvk avatar Feb 16 '22 11:02 ddvk

i mean on the device mount the other partition which has the previous version and use the old sync binary.

mmcblk2p2 or mmcblk2p3 depending on which is the active one

mkdir mnt
mount /dev/mmcblk2p2 mnt
cp mnt/usr/bin/sync /usr/bin

Did the official firmware overwrite /usr/bin/sync and place the old one in /dev/mmcblk2p2 for some reason? Will I stuff anything up with future updates if I copy this old version over? I just don't want to forget that I did this and run into problems down the line...

Myridium avatar Feb 16 '22 11:02 Myridium

there are 2 partitions, every update overwrites the alternative and then switches them (boots the updated one) so the prvevious version is still there. you can just backup the binary, but I think this is a bug on their end and they should fix it in the next release

ddvk avatar Feb 16 '22 11:02 ddvk

Thanks so much for your help @ddvk . Also, there are two extra partitions, (p2 and p3 are present but not mounted). maybe it keeps two old versions.

I did as you suggested. It seems to be working.

At first the output of systemctl status sync seemed to complain about an incompatible tree structure. Then hashes that need to be recomputed. Now it is complaining about resolve: conflict in file: .... But I think it's working. Files are on server.

Cheers

Myridium avatar Feb 16 '22 11:02 Myridium

Just as a confirmation: seems to happen to people using the official cloud, too: https://www.reddit.com/r/RemarkableTablet/comments/sumfxy/sync_issues/?utm_source=share&utm_medium=web2x&context=3

benneti avatar Feb 17 '22 17:02 benneti

I am having the same problem with the crashing sync in 2.12. Unfortunatley I skipped Version 2.10 and 2.11. Does anyone know if the new sync also works with the 2.9 version executable? And if not could someone provide the 2.11 sync executable please. Thanks!

EDIT: I tried it with the 2.9 sync version and it doesn't worked.

marvin-schl avatar Feb 20 '22 18:02 marvin-schl

@marvin-schl https://ufile.io/xo8n96nt sha1: 9a87f0fbb018fda9544ecf28bec673483156407d

ddvk avatar Feb 22 '22 08:02 ddvk

I think this might be closed as newer remarkable versions do work with the current version of the server.

benneti avatar Nov 10 '22 08:11 benneti