docker-icloudpd icon indicating copy to clipboard operation
docker-icloudpd copied to clipboard

Published 20 hours ago • verified publisher icon boredazfcuk

No new files detected

Open matteoveglia opened this issue 2 years ago • 4 comments

Hi,

After battling some strange keyring_pass.cfg issues I finally got the tool to take my password, 2FA and actually save the file.

However now I can't get it to download anything from my iCloud; I have 20k images.

Here's my log, nothing at all untoward.

2022-05-28 10:18:43 INFO ***** boredazfcuk/icloudpd container for icloud_photo_downloader started ***** 2022-05-28 10:18:43 INFO ***** For support, please go here: https://github.com/boredazfcuk/docker-icloudpd ***** 2022-05-28 10:18:43 INFO ***** /usr/local/bin/sync-icloud.sh date: 2022/05/20_13:21 ***** 2022-05-28 10:18:43 INFO ***** /usr/local/bin/sync-icloud.sh hash: REDACTED ***** 2022-05-28 10:18:43 INFO Alpine Linux 3.13.5 2022-05-28 10:18:43 INFO Python version: 3.8.10 WARNING: You are using pip version 22.0.4; however, version 22.1.1 is available. You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command. 2022-05-28 10:18:44 INFO icloudpd version: 1.7.2 WARNING: You are using pip version 22.0.4; however, version 22.1.1 is available. You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command. 2022-05-28 10:18:46 INFO pyicloud-ipd version: 0.10.1 2022-05-28 10:18:46 INFO Running user id: 0 2022-05-28 10:18:46 INFO Running group id: 0 2022-05-28 10:18:46 INFO Local user: root:0 2022-05-28 10:18:46 INFO Local group: root:0 2022-05-28 10:18:46 INFO Force GID: False 2022-05-28 10:18:46 INFO LAN IP Address: 172.27.0.2 2022-05-28 10:18:46 INFO Default gateway: 172.27.0.1 2022-05-28 10:18:46 INFO DNS server: 127.0.0.11 2022-05-28 10:18:46 INFO IP address for icloud.com: 17.253.144.10 2022-05-28 10:18:46 INFO Route check to icloud.com successful 2022-05-28 10:18:46 INFO Apple ID: [email protected] 2022-05-28 10:18:46 INFO Authentication Type: 2FA 2022-05-28 10:18:46 INFO Cookie path: /config/REDACTED 2022-05-28 10:18:46 INFO Cookie expiry notification period: 3 2022-05-28 10:18:46 INFO Download destination directory: /home/root/iCloud 2022-05-28 10:18:46 INFO Folder structure: {:%Y/%m/%d} 2022-05-28 10:18:46 INFO Directory permissions: 750 2022-05-28 10:18:46 INFO File permissions: 640 2022-05-28 10:18:46 INFO Synchronisation interval: 86400 2022-05-28 10:18:46 INFO Synchronisation delay (minutes): 0 2022-05-28 10:18:46 INFO Set EXIF date/time: False 2022-05-28 10:18:46 INFO Auto delete: False 2022-05-28 10:18:46 INFO Photo size: original 2022-05-28 10:18:46 INFO Single pass mode: False 2022-05-28 10:18:46 INFO Skip download check: False 2022-05-28 10:18:46 INFO Skip live photos: False 2022-05-28 10:18:46 INFO Number of most recently added photos to download: Download All Photos 2022-05-28 10:18:46 INFO Downloading photos from album: Download All Photos 2022-05-28 10:18:46 INFO Stop downloading when prexisiting files count is: Download All Photos 2022-05-28 10:18:46 INFO Live photo size: original 2022-05-28 10:18:46 INFO Skip videos: False 2022-05-28 10:18:46 INFO Convert HEIC to JPEG: False 2022-05-28 10:18:46 INFO JPEG conversion quality: 90 2022-05-28 10:18:46 INFO Cleaned notification title: iCloudPD 2022-05-28 10:18:46 INFO Discord notifications enabled 2022-05-28 10:18:46 INFO Discord Discord ID: REDACTED 2022-05-28 10:18:46 INFO Discord Discord token: REDACTED 2022-05-28 10:18:46 INFO Discord notification URL: https://discord.com/api/webhooks/REDACTED/REDACTED 2022-05-28 10:18:46 INFO Sending Discord startup notification 2022-05-28 10:18:46 INFO Discord startup notification sent successfully 2022-05-28 10:18:46 INFO Download notifications: Enabled 2022-05-28 10:18:46 INFO Delete notifications: Enabled 2022-05-28 10:18:46 INFO Downloading from: icloud.com 2022-05-28 10:18:47 INFO Group, root:0, already created 2022-05-28 10:18:47 INFO User, root:0, already created 2022-05-28 10:18:47 INFO Set owner, root, on iCloud directory, if required 2022-05-28 10:18:47 INFO Set group, root, on iCloud directory, if required 2022-05-28 10:18:47 INFO Correct owner on icloudpd temp directory, if required 2022-05-28 10:18:47 INFO Correct group on icloudpd temp directory, if required 2022-05-28 10:18:47 INFO Correct owner on config directory, if required 2022-05-28 10:18:47 INFO Correct group on config directory, if required 2022-05-28 10:18:47 INFO Correct owner on keyring directory, if required 2022-05-28 10:18:47 INFO Correct group on keyring directory, if required 2022-05-28 10:18:47 INFO Set 750 permissions on iCloud directories, if required 2022-05-28 10:18:47 INFO Set 640 permissions on iCloud files, if required 2022-05-28 10:18:47 INFO Configure password 2022-05-28 10:18:47 INFO Using password stored in keyring file: /config/python_keyring/keyring_pass.cfg 2022-05-28 10:18:47 INFO Check download directory mounted correctly 2022-05-28 10:18:47 INFO Failsafe file /home/root/iCloud/.mounted exists, continuing 2022-05-28 10:18:47 INFO Set owner, root, on iCloud directory, if required 2022-05-28 10:18:47 INFO Set group, root, on iCloud directory, if required 2022-05-28 10:18:47 INFO Correct owner on icloudpd temp directory, if required 2022-05-28 10:18:47 INFO Correct group on icloudpd temp directory, if required 2022-05-28 10:18:47 INFO Correct owner on config directory, if required 2022-05-28 10:18:47 INFO Correct group on config directory, if required 2022-05-28 10:18:47 INFO Correct owner on keyring directory, if required 2022-05-28 10:18:47 INFO Correct group on keyring directory, if required 2022-05-28 10:18:47 INFO Set 750 permissions on iCloud directories, if required 2022-05-28 10:18:47 INFO Set 640 permissions on iCloud files, if required 2022-05-28 10:18:47 INFO Sync user root 2022-05-28 10:18:47 INFO Synchronisation starting at 10:18:47 2022-05-28 10:18:47 INFO Check 2FA Cookie 2022-05-28 10:18:47 INFO Cookie exists, check expiry date 2022-05-28 10:18:47 INFO Valid two factor authentication cookie found. Days until expiration: 90 2022-05-28 10:18:47 INFO Check download directory mounted correctly 2022-05-28 10:18:47 INFO Failsafe file /home/root/iCloud/.mounted exists, continuing 2022-05-28 10:18:47 INFO Check for new files using password stored in keyring file 2022-05-28 10:18:47 INFO Generating list of files in iCloud. This may take a long time if you have a large photo collection. Please be patient. Nothing is being downloaded at this time 2022-05-28 10:18:53 INFO Check successful 2022-05-28 10:18:53 INFO No new files detected. Nothing to download 2022-05-28 10:18:53 INFO Web cookie expires: 2022-07-27 @ 17:09:41 2022-05-28 10:18:53 INFO Two factor authentication cookie expires: 2022-08-26 @ 17:09:50 2022-05-28 10:18:53 INFO Days remaining until expiration: 90 2022-05-28 10:18:53 INFO iCloud login counter = 1 2022-05-28 10:18:53 INFO Synchronisation ended at 10:18:53 2022-05-28 10:18:53 INFO Total time taken: 00:00:06 2022-05-28 10:18:53 INFO Next synchronisation at 10:18:47

Originally posted by @matteoveglia in https://github.com/boredazfcuk/docker-icloudpd/issues/161#issuecomment-1140301703

matteoveglia avatar May 31 '22 06:05 matteoveglia

Hi,

Try setting skip_check=True.

Some users with a large number of files report that the check can cause issues.

Thanks.

boredazfcuk avatar Jul 16 '22 12:07 boredazfcuk

Hey! Thanks for getting back to me, unfortunately nothing different with that. This time I switched from OMV to Unraid, so it's a brand new system, I feel like I'm missing something obvious here.

Here's my latest log, I'm running the docker instance as root (PUID & PGID = 0):

2022-08-04 20:32:27 INFO ***** boredazfcuk/icloudpd container for icloud_photo_downloader started ***** 2022-08-04 20:32:27 INFO ***** For support, please go here: https://github.com/boredazfcuk/docker-icloudpd ***** 2022-08-04 20:32:27 INFO ***** /usr/local/bin/sync-icloud.sh date: 2022/07/28_08:36 ***** 2022-08-04 20:32:27 INFO ***** /usr/local/bin/sync-icloud.sh hash: 26e41c308a82ed0664ce3dc3cc10c916 ***** 2022-08-04 20:32:27 INFO Alpine Linux 3.13.5 2022-08-04 20:32:27 INFO Python version: 3.8.10 WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag. 2022-08-04 20:32:28 INFO icloudpd version: 1.7.2 WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag. 2022-08-04 20:32:30 INFO pyicloud-ipd version: 0.10.1 2022-08-04 20:32:30 INFO Running user id: 0 2022-08-04 20:32:30 INFO Running group id: 0 2022-08-04 20:32:30 INFO Local user: user:1000 2022-08-04 20:32:30 INFO Local group: group:1000 2022-08-04 20:32:30 INFO Force GID: False 2022-08-04 20:32:30 INFO LAN IP Address: 172.17.0.3 2022-08-04 20:32:30 INFO Default gateway: 172.17.0.1 2022-08-04 20:32:30 INFO DNS server: 8.8.8.8 2022-08-04 20:32:30 INFO IP address for icloud.com: 17.253.144.10 2022-08-04 20:32:30 INFO Route check to icloud.com successful 2022-08-04 20:32:30 INFO Apple ID: [email protected] 2022-08-04 20:32:30 INFO Authentication Type: 2FA 2022-08-04 20:32:30 INFO Cookie path: /config/matteodvmecom 2022-08-04 20:32:30 INFO Cookie expiry notification period: 7 2022-08-04 20:32:30 INFO Download destination directory: /home/user/iCloud 2022-08-04 20:32:30 INFO Folder structure: {:%Y/%m/%d} 2022-08-04 20:32:30 INFO Directory permissions: 777 2022-08-04 20:32:30 INFO File permissions: 666 2022-08-04 20:32:30 INFO Synchronisation interval: 86400 2022-08-04 20:32:30 INFO Synchronisation delay (minutes): 0 2022-08-04 20:32:30 INFO Set EXIF date/time: False 2022-08-04 20:32:30 INFO Auto delete: False 2022-08-04 20:32:30 INFO Photo size: original 2022-08-04 20:32:30 INFO Single pass mode: False 2022-08-04 20:32:30 INFO Skip download check: True 2022-08-04 20:32:30 INFO Skip live photos: False 2022-08-04 20:32:30 INFO Number of most recently added photos to download: Download All Photos 2022-08-04 20:32:30 INFO Downloading photos from album: Download All Photos 2022-08-04 20:32:30 INFO Stop downloading when prexisiting files count is: Download All Photos 2022-08-04 20:32:30 INFO Live photo size: original 2022-08-04 20:32:30 INFO Skip videos: False 2022-08-04 20:32:30 INFO Convert HEIC to JPEG: False 2022-08-04 20:32:30 INFO JPEG conversion quality: 90 2022-08-04 20:32:30 INFO Cleaned notification title: iCloudPD 2022-08-04 20:32:30 INFO Discord notifications enabled 2022-08-04 20:32:30 INFO Discord Discord ID: REDACTED 2022-08-04 20:32:30 INFO Discord Discord token: REDACTED 2022-08-04 20:32:30 INFO Discord notification URL: REDACTED 2022-08-04 20:32:30 INFO Sending Discord startup notification 2022-08-04 20:32:31 INFO Discord startup notification sent successfully 2022-08-04 20:32:31 INFO Download notifications: Enabled 2022-08-04 20:32:31 INFO Delete notifications: Enabled 2022-08-04 20:32:31 INFO Downloading from: icloud.com WARNING: The directory '/root/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag. 2022-08-04 20:32:32 INFO Nextcloud synchronisation trigger: Enabled 2022-08-04 20:32:32 INFO Group, group:1000, already created 2022-08-04 20:32:32 INFO User, user:1000, already created 2022-08-04 20:32:32 INFO Set owner, user, on iCloud directory, if required 2022-08-04 20:32:32 INFO Set group, group, on iCloud directory, if required 2022-08-04 20:32:32 INFO Correct owner on icloudpd temp directory, if required 2022-08-04 20:32:32 INFO Correct group on icloudpd temp directory, if required 2022-08-04 20:32:32 INFO Correct owner on config directory, if required 2022-08-04 20:32:32 INFO Correct group on config directory, if required 2022-08-04 20:32:32 INFO Correct owner on keyring directory, if required 2022-08-04 20:32:32 INFO Correct group on keyring directory, if required 2022-08-04 20:32:32 INFO Set 777 permissions on iCloud directories, if required 2022-08-04 20:32:32 INFO Set 666 permissions on iCloud files, if required 2022-08-04 20:32:32 INFO Configure password 2022-08-04 20:32:32 INFO Using password stored in keyring file: /config/python_keyring/keyring_pass.cfg 2022-08-04 20:32:32 INFO Check download directory mounted correctly 2022-08-04 20:32:32 INFO Failsafe file /home/user/iCloud/.mounted exists, continuing 2022-08-04 20:32:32 INFO Set owner, user, on iCloud directory, if required 2022-08-04 20:32:32 INFO Set group, group, on iCloud directory, if required 2022-08-04 20:32:32 INFO Correct owner on icloudpd temp directory, if required 2022-08-04 20:32:32 INFO Correct group on icloudpd temp directory, if required 2022-08-04 20:32:32 INFO Correct owner on config directory, if required 2022-08-04 20:32:32 INFO Correct group on config directory, if required 2022-08-04 20:32:32 INFO Correct owner on keyring directory, if required 2022-08-04 20:32:32 INFO Correct group on keyring directory, if required 2022-08-04 20:32:32 INFO Set 777 permissions on iCloud directories, if required 2022-08-04 20:32:32 INFO Set 666 permissions on iCloud files, if required 2022-08-04 20:32:32 INFO Sync user user 2022-08-04 20:32:32 INFO Synchronisation starting at 20:32:32 2022-08-04 20:32:32 INFO Check 2FA Cookie 2022-08-04 20:32:32 INFO Cookie exists, check expiry date 2022-08-04 20:32:32 INFO Valid two factor authentication cookie found. Days until expiration: 90 2022-08-04 20:32:32 INFO Check download directory mounted correctly 2022-08-04 20:32:32 INFO Failsafe file /home/user/iCloud/.mounted exists, continuing 2022-08-04 20:32:32 INFO Starting download of new files for user: user 2022-08-04 20:32:32 INFO Downloading new files using password stored in keyring file... 2022-08-04 20:32:32 INFO iCloudPD launch command: /usr/bin/icloudpd --directory /home/user/iCloud --cookie-directory /config --folder-structure {:%Y/%m/%d} --username [email protected] 2>/tmp/icloudpd/icloudpd_download_error 2022-08-04 20:32:33 DEBUG Authenticating... 2022-08-04 20:32:37 DEBUG Looking up all photos and videos from album All Photos... 2022-08-04 20:32:37 INFO Downloading 0 original photos and videos to /home/user/iCloud ... 2022-08-04 20:32:38 INFO All photos have been downloaded! 2022-08-04 20:32:38 INFO Set owner, user, on iCloud directory, if required 2022-08-04 20:32:38 INFO Set group, group, on iCloud directory, if required 2022-08-04 20:32:38 INFO Correct owner on icloudpd temp directory, if required 2022-08-04 20:32:38 INFO Correct group on icloudpd temp directory, if required 2022-08-04 20:32:38 INFO Correct owner on config directory, if required 2022-08-04 20:32:38 INFO Correct group on config directory, if required 2022-08-04 20:32:38 INFO Correct owner on keyring directory, if required 2022-08-04 20:32:38 INFO Correct group on keyring directory, if required 2022-08-04 20:32:38 INFO Set 777 permissions on iCloud directories, if required 2022-08-04 20:32:38 INFO Set 666 permissions on iCloud files, if required 2022-08-04 20:32:38 INFO Synchronisation complete for user 2022-08-04 20:32:38 INFO Web cookie expires: 2022-10-04 @ 03:31:43 2022-08-04 20:32:38 INFO Two factor authentication cookie expires: 2022-11-03 @ 03:31:53 2022-08-04 20:32:38 INFO Days remaining until expiration: 90 2022-08-04 20:32:38 INFO iCloud login counter = 1 2022-08-04 20:32:38 INFO Synchronisation ended at 20:32:38 2022-08-04 20:32:38 INFO Total time taken: 00:00:06 2022-08-04 20:32:38 INFO Next synchronisation at 20:32:32

matteoveglia avatar Aug 05 '22 03:08 matteoveglia

Hi,

Sorry I've been a bit too busy to deal with issues in the evenings.

One thing I noticed is this line:

2022-08-04 20:32:37 INFO Downloading 0 original photos and videos to /home/user/iCloud ...

...so, as far as the app is concerned, there aren't any photos in your iCloud account.

They're not moved into albums? In the hidden folder? In the 'Recently Deleted' folder? If you log on to iCloud.com and look at the photos in there... You can see them all?

boredazfcuk avatar Aug 24 '22 20:08 boredazfcuk

Quick one... Some people have said that there is a new library mode for iOS16 which is a 'shared library'.

If you have changed your default library mode to this, then that may be the reason it cannot find any photos... The photos are in a library it cannot access.

boredazfcuk avatar Aug 24 '22 21:08 boredazfcuk

Closing this off as no update since August.

boredazfcuk avatar Oct 08 '22 13:10 boredazfcuk