integration_google icon indicating copy to clipboard operation
integration_google copied to clipboard

Google Photos : stucks at 0%

Open Rwanito opened this issue 1 year ago • 7 comments

Hi !

I'm trying to import my google photos with this app. But actually, it's stuck.

1189 Photos Google (>1 GiB) 0 photo importée

I don't have anything to debug or any message. Do you have an idea?

Thank you! Erwan

Rwanito avatar Sep 08 '22 09:09 Rwanito

Any error in the server logs?

julien-nc avatar Sep 08 '22 09:09 julien-nc

For contacts I have : Could not load event listener service OCA\\Maps\\Listener\\CardCreatedListener: Could not resolve logger! Class \"logger\" does not exist. Make sure the class is auto-loadable by the Nextcloud server container I cut the message because it's massive. But no problem with contacts.

And for Photos, I don't find any clear traces of "Photos", "Google Photos", in the logs. But I got this : "message": "Taille du fichier attendue : 996 octets mais taille du fichier lue (depuis le client Nextcloud) et \u00e9crit (dans le stockage Nextcloud) : 0 octet. Cela peut \u00eatre un probl\u00e8me de r\u00e9seau au niveau du client ou un probl\u00e8me de stockage au niveau du serveur.",

In english, it means something like : It got 996 bytes but the file size received from nextcloud is 0 byte. Problably due to the nextcloud store.

Everything is clear in my server, but do you think it may come from my reverse proxy ?

Thank you !

ghost avatar Sep 08 '22 10:09 ghost

Same issue with helm chart. I thought it was on my side. Next cloud 24.0.3-apache https://help.nextcloud.com/t/ocp-appframework-queryexception-could-not-resolve-logger-class-logger-does-not-exist-update-failed/135468

{"reqId":"CjkKtjSRcCIss6Ml14Ub","level":3,"time":"2022-09-08T14:22:48+00:00","remoteAddr":"1.1.1.1","user":"admin","app":"no app in context","method":"GET","url":"/apps/integration_google/import-contacts?key=0&newAddressBookName=Google+Contacts+import","message":"Could not load event listener service OCA\\Maps\\Listener\\CardCreatedListener: Could not resolve logger! Class \"logger\" does not exist. Make sure the class is auto-loadable by the Nextcloud server container","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","version":"24.0.3.2","exception":{"Exception":"OCP\\AppFramework\\QueryException","Message":"Could not resolve logger! Class \"logger\" does not exist","Code":0,"Trace":[{"function":"OC\\AppFramework\\Utility\\{closure}","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":108,"function":"array_map","args":[{"__class__":"Closure"},[{"__class__":"ReflectionParameter","name":"addressService"},"*** sensitive parameters replaced ***"]]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":116,"function":"buildClass","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":[{"__class__":"ReflectionClass","name":"OCA\\Maps\\Listener\\CardCreatedListener"}]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":133,"function":"resolve","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["OCA\\Maps\\Listener\\CardCreatedListener"]},{"file":"/var/www/html/lib/private/ServerContainer.php","line":161,"function":"query","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["OCA\\Maps\\Listener\\CardCreatedListener",true]},{"file":"/var/www/html/lib/private/EventDispatcher/ServiceEventListener.php","line":71,"function":"query","class":"OC\\ServerContainer","type":"->","args":["OCA\\Maps\\Listener\\CardCreatedListener"]},{"file":"/var/www/html/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":251,"function":"__invoke","class":"OC\\EventDispatcher\\ServiceEventListener","type":"->","args":[{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"},"OCA\\DAV\\Events\\CardCreatedEvent",{"__class__":"Symfony\\Component\\EventDispatcher\\EventDispatcher"}]},{"file":"/var/www/html/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":73,"function":"callListeners","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->","args":[[{"__class__":"Closure"},{"__class__":"Closure"}],"OCA\\DAV\\Events\\CardCreatedEvent",{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"}]},{"file":"/var/www/html/lib/private/EventDispatcher/EventDispatcher.php","line":88,"function":"dispatch","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->","args":[{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"},"OCA\\DAV\\Events\\CardCreatedEvent"]},{"file":"/var/www/html/lib/private/EventDispatcher/EventDispatcher.php","line":100,"function":"dispatch","class":"OC\\EventDispatcher\\EventDispatcher","type":"->","args":["OCA\\DAV\\Events\\CardCreatedEvent",{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"}]},{"file":"/var/www/html/apps/dav/lib/CardDAV/CardDavBackend.php","line":692,"function":"dispatchTyped","class":"OC\\EventDispatcher\\EventDispatcher","type":"->","args":[{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"}]},{"file":"/var/www/html/custom_apps/integration_google/lib/Service/GoogleContactsAPIService.php","line":337,"function":"createCard","class":"OCA\\DAV\\CardDAV\\CardDavBackend","type":"->","args":[3,"goog490","BEGIN:VCARD\r----REMOVED-PERSONAL-DATA----\r\n"]},{"file":"/var/www/html/custom_apps/integration_google/lib/Controller/GoogleAPIController.php","line":247,"function":"importContacts","class":"OCA\\Google\\Service\\GoogleContactsAPIService","type":"->","args":["admin","",3,"Google Contacts import"]},{"file":"/var/www/html/lib/private/AppFramework/Http/Dispatcher.php","line":225,"function":"importContacts","class":"OCA\\Google\\Controller\\GoogleAPIController","type":"->","args":["",0,"Google Contacts import"]},{"file":"/var/www/html/lib/private/AppFramework/Http/Dispatcher.php","line":133,"function":"executeController","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OCA\\Google\\Controller\\GoogleAPIController"},"importContacts"]},{"file":"/var/www/html/lib/private/AppFramework/App.php","line":172,"function":"dispatch","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OCA\\Google\\Controller\\GoogleAPIController"},"importContacts"]},{"file":"/var/www/html/lib/private/Route/Router.php","line":298,"function":"main","class":"OC\\AppFramework\\App","type":"::","args":["OCA\\Google\\Controller\\GoogleAPIController","importContacts",{"__class__":"OC\\AppFramework\\DependencyInjection\\DIContainer"},["integration_google.googleAPI.importContacts"]]},{"file":"/var/www/html/lib/base.php","line":1023,"function":"match","class":"OC\\Route\\Router","type":"->","args":["/apps/integration_google/import-contacts"]},{"file":"/var/www/html/index.php","line":36,"function":"handleRequest","class":"OC","type":"::","args":[]}],"File":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","Line":102,"Previous":{"Exception":"OCP\\AppFramework\\QueryException","Message":"Could not resolve OCA\\Maps\\Listener\\ILogger! Class \"OCA\\Maps\\Listener\\ILogger\" does not exist","Code":0,"Trace":[{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":133,"function":"resolve","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["OCA\\Maps\\Listener\\ILogger"]},{"file":"/var/www/html/lib/private/ServerContainer.php","line":161,"function":"query","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["OCA\\Maps\\Listener\\ILogger",true]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":89,"function":"query","class":"OC\\ServerContainer","type":"->","args":["OCA\\Maps\\Listener\\ILogger",true]},{"function":"OC\\AppFramework\\Utility\\{closure}","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":108,"function":"array_map","args":[{"__class__":"Closure"},[{"__class__":"ReflectionParameter","name":"addressService"},"*** sensitive parameters replaced ***"]]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":116,"function":"buildClass","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":[{"__class__":"ReflectionClass","name":"OCA\\Maps\\Listener\\CardCreatedListener"}]},{"file":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","line":133,"function":"resolve","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["OCA\\Maps\\Listener\\CardCreatedListener"]},{"file":"/var/www/html/lib/private/ServerContainer.php","line":161,"function":"query","class":"OC\\AppFramework\\Utility\\SimpleContainer","type":"->","args":["OCA\\Maps\\Listener\\CardCreatedListener",true]},{"file":"/var/www/html/lib/private/EventDispatcher/ServiceEventListener.php","line":71,"function":"query","class":"OC\\ServerContainer","type":"->","args":["OCA\\Maps\\Listener\\CardCreatedListener"]},{"file":"/var/www/html/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":251,"function":"__invoke","class":"OC\\EventDispatcher\\ServiceEventListener","type":"->","args":[{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"},"OCA\\DAV\\Events\\CardCreatedEvent",{"__class__":"Symfony\\Component\\EventDispatcher\\EventDispatcher"}]},{"file":"/var/www/html/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":73,"function":"callListeners","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->","args":[[{"__class__":"Closure"},{"__class__":"Closure"}],"OCA\\DAV\\Events\\CardCreatedEvent",{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"}]},{"file":"/var/www/html/lib/private/EventDispatcher/EventDispatcher.php","line":88,"function":"dispatch","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->","args":[{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"},"OCA\\DAV\\Events\\CardCreatedEvent"]},{"file":"/var/www/html/lib/private/EventDispatcher/EventDispatcher.php","line":100,"function":"dispatch","class":"OC\\EventDispatcher\\EventDispatcher","type":"->","args":["OCA\\DAV\\Events\\CardCreatedEvent",{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"}]},{"file":"/var/www/html/apps/dav/lib/CardDAV/CardDavBackend.php","line":692,"function":"dispatchTyped","class":"OC\\EventDispatcher\\EventDispatcher","type":"->","args":[{"__class__":"OCA\\DAV\\Events\\CardCreatedEvent"}]},{"file":"/var/www/html/custom_apps/integration_google/lib/Service/GoogleContactsAPIService.php","line":337,"function":"createCard","class":"OCA\\DAV\\CardDAV\\CardDavBackend","type":"->","args":[3,"goog490","BEGIN:VCARD ----REMOVED-PERSONAL-DATA--- \r\n"]},{"file":"/var/www/html/custom_apps/integration_google/lib/Controller/GoogleAPIController.php","line":247,"function":"importContacts","class":"OCA\\Google\\Service\\GoogleContactsAPIService","type":"->","args":["admin","",3,"Google Contacts import"]},{"file":"/var/www/html/lib/private/AppFramework/Http/Dispatcher.php","line":225,"function":"importContacts","class":"OCA\\Google\\Controller\\GoogleAPIController","type":"->","args":["",0,"Google Contacts import"]},{"file":"/var/www/html/lib/private/AppFramework/Http/Dispatcher.php","line":133,"function":"executeController","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OCA\\Google\\Controller\\GoogleAPIController"},"importContacts"]},{"file":"/var/www/html/lib/private/AppFramework/App.php","line":172,"function":"dispatch","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OCA\\Google\\Controller\\GoogleAPIController"},"importContacts"]},{"file":"/var/www/html/lib/private/Route/Router.php","line":298,"function":"main","class":"OC\\AppFramework\\App","type":"::","args":["OCA\\Google\\Controller\\GoogleAPIController","importContacts",{"__class__":"OC\\AppFramework\\DependencyInjection\\DIContainer"},["integration_google.googleAPI.importContacts"]]},{"file":"/var/www/html/lib/base.php","line":1023,"function":"match","class":"OC\\Route\\Router","type":"->","args":["/apps/integration_google/import-contacts"]},{"file":"/var/www/html/index.php","line":36,"function":"handleRequest","class":"OC","type":"::","args":[]}],"File":"/var/www/html/lib/private/AppFramework/Utility/SimpleContainer.php","Line":122},"message":"Could not load event listener service OCA\\Maps\\Listener\\CardCreatedListener: Could not resolve logger! Class \"logger\" does not exist. Make sure the class is auto-loadable by the Nextcloud server container","exception":{},"CustomMessage":"Could not load event listener service OCA\\Maps\\Listener\\CardCreatedListener: Could not resolve logger! Class \"logger\" does not exist. Make sure the class is auto-loadable by the Nextcloud server container"}}

Screenshot_2022-09-08_17-27-35

Enelar avatar Sep 08 '22 14:09 Enelar

Fixed by increasing php memory limit in configs

Enelar avatar Sep 08 '22 15:09 Enelar

Fixed by increasing php memory limit in configs

Enelar avatar Sep 08 '22 15:09 Enelar

Hey! I have this in my php.ini

upload_max_filesize=5G
post_max_size=5G
memory_limit=20G

And it changes nothing :(

Is it possible to do with Google takeout and then uploading them ?

Thank you

ghost avatar Sep 09 '22 09:09 ghost

I've found the api https://gist.github.com/stewartmcgown/7f5dcbf4ccd385637786f9581b620e6a But it's much easier to log in to your server, and download the archieve for yourself: https://webapps.stackexchange.com/questions/123300/how-to-programmatically-create-download-google-takeout-archive

Also, check the final values with php info. I've changed my in config.php, maybe there is some inner logics in next cloud

Enelar avatar Sep 11 '22 16:09 Enelar

see this for fixing google not importing anymore: the fix

lilfade avatar Nov 17 '22 13:11 lilfade

A fix is potentially coming in the next release. If you want to test it: https://github.com/nextcloud/integration_google/issues/35#issuecomment-1361381136

julien-nc avatar Dec 21 '22 14:12 julien-nc

hi all,

I have the same issue and I think this is a pity due to i think it's a powerful tool in order to use more NextCloud and less Google. I tried several times and ways last 3 months without lucky... Sometimes I've seen some photo imported but less than 60.... the most of times stuck in 0% and 0 photos imported....

Let me show my environment

sudo -u www-data php /opt/nextcloud/occ status --output=json_pretty
{
    "installed": true,
    "version": "25.0.4.1",
    "versionstring": "25.0.4",
    "edition": "",
    "maintenance": false,
    "needsDbUpgrade": false,
    "productname": "Nextcloud",
    "extendedSupport": false
}

this is the volume to import

 >69542 Google photos (>64 GiB)

0 photos imported
Photo import background process will begin soon. You can close this page. You will be notified when it finishes.

I tried to increase php values without luchy....

upload_max_filesize=5G
post_max_size=5G
memory_limit=20G
  1. Let me share nextcloud.log file starting Photo Importing with app - integration_google: 1.0.9 afterPushButtonImportGooglePhotos.tar.gz
  2. I also upgraded integration_google to v1.0.9-2-nightly but I can see the menu changes from Data migration to Google Synchronization but I receive an error , it seems something related on javascript, let me attach an screenshoot. Screenshot_20230225_093955

mcortinas avatar Feb 25 '23 11:02 mcortinas

Let me share more, I ran another instance of Nextcloud in my rapsberrypi4 but this time with docker, i launched the all-in-one with docker-compose with more lucky, this time has been imported 4k images in 6hours, more or less....

mcortinas avatar Feb 26 '23 08:02 mcortinas

I was having this issue and figured out it was because my cron jobs weren't configured properly. I also installed the nightly version, but it still didn;t work until I got my cron job set up correctly, so I'm not sure that was necessary.

etuckeriv avatar Feb 28 '23 16:02 etuckeriv

Is someone hacking my phone because this stuff is on my phone I need some kind of help because I don't know nothing. No computers or phones

slkwilly19 avatar Mar 03 '23 08:03 slkwilly19

Hi All,

I'm running into this issue also, had no problem importing contacts however been suck at 0% for the last couple hours, did a cancel and re-import to no effect, happy to try something else if people have any ideas.

Cheers

N-Soder avatar Mar 19 '23 10:03 N-Soder

Same issue, stuck at 0 photos

Error   PHP   Error: dns_get_record(): A temporary server error occurred. at /var/www/html/lib/private/Http/Client/DnsPinMiddleware.php#83 at lib/private/Log/ErrorHandler.php line 92
0. <<closure>>
  OC\Log\ErrorHandler::onError(
    2,
    "dns_get_record(): A temporary server error occurred.",
    "\/var\/www\/html\/lib\/private\/Http\/Client\/DnsPinMiddleware.php",
    83
  )
1. lib/private/Http/Client/DnsPinMiddleware.php line 83
  dns_get_record("photoslibrary.googleapis.com", 16)

janeoa avatar Mar 22 '23 09:03 janeoa

Hey everyone! Could you please try again with the latest version?

marcelklehr avatar Jun 02 '23 11:06 marcelklehr