offlineimap icon indicating copy to clipboard operation
offlineimap copied to clipboard

Renamed gmail folders are skipped

Open dzieko opened this issue 5 years ago • 9 comments

General informations

  • system/distribution (with version):
lsb_release -a
LSB Version:    n/a
Distributor ID: openSUSE
Description:    openSUSE Leap 15.0
Release:        15.0
Codename:       n/a
  • offlineimap version (offlineimap -V):
offlineimap v7.2.3, imaplib2 v2.57 (bundled), Python v2.7.14, OpenSSL 1.1.0i-fips  14 Aug 2018
  • Python version:
python -V
Python 2.7.14
  • server name or domain: gmail

  • CLI options:

~/git/offlineimap/offlineimap.py -c ~/.offlineimaprc.test 

Configuration file offlineimaprc

[general]
accounts = gmail

[Account gmail]
localrepository = gmail-local-mirror
remoterepository = gmail-server

[Repository gmail-local-mirror]
type = GmailMaildir
localfolders = /home/dziekopr/poczta/gmail

[Repository gmail-server]
type = Gmail
remoteuser = xxx
remotepass = xxx
sslcacertfile = /etc/ssl/ca-bundle.pem
auth_mechanisms = LOGIN
readonly = True

Logs, error

https://drive.google.com/open?id=1O6atg__wABj5XReO4zJeb04briXPsQsO

Steps to reproduce the error

This is related to gmail. I have a folder "wakacje" with some emails and about 15 sub-folders. I have renamed all those sub-folders recently. Old name: wakacje/year-name New name: wakacje/year.month-name

Those renamed sub-folders are not synchronized now. Log shows just a bunch of empty lines, even with -dALL:

Folder inne/xxx [acc: gmail]:
 Syncing inne/xxx: Gmail -> GmailMaildir
Account sync gmail:
 
[ ... a bunch of empty lines ... ]
 
Folder wakacje [acc: gmail]:
 Syncing wakacje: Gmail -> GmailMaildir
Account sync gmail:
 *** Finished account 'gmail' in 0:14

LocalStatus files are created but FolderValidity not.

Sub-directories on my local filesystem are created but not populated with emails. Deleting everything does not help.

thanks, Pawel

dzieko avatar Jun 04 '19 06:06 dzieko

What's the output of offlineimap --info?

nicolas33 avatar Jun 04 '19 20:06 nicolas33

I can provide output of this command but it contains a lot of my private folder names. Is the a way to make it not visible publicly?

dzieko avatar Jun 04 '19 21:06 dzieko

Here is my pubkey (PKCS8):

-----BEGIN PUBLIC KEY-----
MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAvvvx24oHAM/UnJYkNCHK
ogNfCyBZdg/bw+W2CNzlDWIK/wQ8IJwNHNDT0LmsZbkd/HY6LiE98haDqxJSZ8Ht
HJ6tAZzjPiYRA4GDvq1xMs0jKqv6vvINEEt5U47ofYLc8taSmgIeWruVW4I5UBAq
6ZTbzRjrOnIiTf5uPAQAS1bXuj4ckTNbIOkkn6SZNORDsCXupG66N9KMikfUEcty
bARqTS+0Bcagx7cJkG1YDw/2QoXWEE7yfBpgLByyDmbphR6AS1BvawNKNBZMYSP8
kmxbB4CEig0nenlZhsP2CjIb4nkDmqj8LJYP0xSiNwljlxlVg66p9NG+qAOcu/r3
FQIDAQAB
-----END PUBLIC KEY-----

nicolas33 avatar Jun 04 '19 22:06 nicolas33

Please find below the encryption key and encrypted file. I'm using this script for encryption and decryption: https://sshenc.sh/sshenc.sh

Thanks!

-- key uC7S5YFF8oywkOxQQO4KuKSEI/ODnvgXMZc9ZYfyup3nunlwp/yOfQejisQt9PrG J7rK7fp2V0HeqBN2/K9MPyLAnmwncLQXHnHa/nxOK4MRRRb+sNB+/7jWhNmitEq6 OmqFFwXGuaNCaD3yQBuPWiFeDiARGtMVf1eP5SkesvLHdGwmI6S0sHQ3ObExXdg4 YR6SyfgcNs81oF1Kj40VopT5dR2DcLyObMxpBD2k9dht6L3+0kKEwiSLHNcyR4j4 gJqbXGxuNMNBF54i+8ds4eMBMMiBDakrroDxhL8kpayH6CFv4BK3XZGrHZ5OzHtZ 2Eh2bq+lLd9UQgkx9h9j3g== -- /key

-- file U2FsdGVkX18gIw9eLwfiUDpXwNSj2Y78gkRBcZL/T0K9rm6W+ZsaPWyIx1auJFWy UAIB+1FS9Z6DXE+suvCEw3FZ2aS6jB4rATfoRonYiSZV1KgfjwdFlwGKAJymcOu3 0HWWkTOTXNOle+appG4+Ci/f3fqZEc/I0yh1uSo1FKc3g2Tm4GVZFXF/JUKdm7L4 fuw1oWRx99CPVD9d18qEy9h6vYwONg9Wk8sTlhhAzPRiYWs73xGf71dXOnjWujRO XdrrIpu6tM5ru9dAysNHfDKD2pTN0eguAf6hY7/22Wt9tA7KuFpMF7iBCfkVZ3GC 6lMYBJOuxfYhSz0vFm0o8e3VS06axHeFKusVxd96TYFkTYtZXPwr8+pCE3lMpu8w tJL2HFw/qXhpZ65pb+o/6pAYwNFqhdFsUCvytQecGTXExt19SQWFRk3XmrYz6n+I 6jAJtUMjU4RbF8ScCD2G/D4F1JvRmbRnradoFrAiCv9i7rl3HTqloID2z5MQTnco 0mEoP+sVTUyV4ktpulbC9Rp84G+WyDfHzEE9btXRy50R4E1HVwqXi2nT+i/Xd3L1 9Oij8P20TIew580h4a0h9tuZiMgSmjy/H+JxWWz3LFt5UfvBeWkTXKlomMksok0y rI35Z9DF+6dsYq2Uyp8hE9XCmwa5h+n+Yh/kytSpPKE+/njmIaHF4SQAUIFqGhXN 8mkmk89cDKfgd6bunQecbHfeRUCOH5+AqHL6zL9mBj1wwnj3AHD2lBHb+UymzMjR epqPKtA8JZXPDFPs8jqSo0Lpz11N7kbViXU/Laorq5QhDIYgEWWXw3F+RpCs1Lq1 yOfNzatgoTT2IBT9PLWg9R1UU8l/SAyqSF2VeBYM21y2PdURN9gzXgmBD4yEq7RK /Q0nQZBMkzvOPSYSzA7NroNRgI5A+GuTKqrJl4eh81oPaqA45c3e4Z/C1AUNklrb v3XHhAmeWYxK9oTAr7F4pw7xBzDjEmKKr2PcOlwZUfnZRMIbBKUG0mqtJCIEbQac /g5JSqobNwUFZbIgLvqabjYFNpLQm/elqzLPbJD9gNYyY5dk5pqhasAgIq57ELq0 +edEhhr8InOKIQp4dBUfmAz82YbEWM53Ym/cJrZGvM61nRbYZMBNz9CoBdSJ6E25 +yE2UPh8bxsrIqKGFcMgjWDxeewvQ1a/SS5Wm/hmbhQNyk7lNRvALiVRrEBK5UNd 4zSxAXntpBcMWrvCc39bFygzWU9hgZK7CvYRgH3Cm4C7MQLjLb6DwEBZ0Y0/p7AO YlPpDCSSHn4ZjXpi4lX9eHq2jG3TMv0p5WDeqxduFQj7NEqyPLNuojNul1c8YjVE MGQjfgSXL+d6p5Qcs4Fb6DRUppyEtn9qABUVPzGwNxdaqdYGEgrzOcddfwkzUeKT JwiWC0opyj20MQ9YBo+eSa35r4jnETJKJg4S4kpSkWMnNNzbxJI7IXObq4VC3ds/ jBnBz6DKGfRer6/GLchvTeK4vkJFfbAb8GVqNaTnO1yrjvE37ALCB2xfZ8NXzzJo nyUulo4cU8tKKrx4d7uZTCUMLhbmbk5dqK0+iYiaCDdRpR74Nez/Tjef4wadkzOL 3DRhWQIsj+jg/LI6icPfJOGV2u4nZpwYHbXWhm4ImvhiIMYEv2zI5NYmVksy3h3u w5j5BU8ay0ZNTaj9vcWz2hsSwI6RgwHvexCVkWiCjC7dN9JBNy1t2SEPU+pUpAdt u57Oh4sRHhWQMPbLgLB0pfoPUpsBXKG2mH3IZCc4hg4xXdEQ8pU2MKAc4U0LKAh6 RiPC+fAAuRbHsVaXxV34iyq2fQMsDvdTrbvWWl59a2oWMEpWlbzJp5Eqgeuxq4dr X5eLs8j7swM9tnmUsSMcHH7ah1ouu2rV/ols/y+ghAcyRT/S6UjV9Xh3BE0y04zy zRP2CQfBRHNtRPaTKU+ncFPpHTmXb/SWYH1VxVQxninKAYv0n3wxr5n7+L8HTqxW Xm6ubIf5Se9G1wKHYbI2HPWLsFC8NTg48ssGJ/QJVpAGmbh2tywwyp7odKOlWAvm EbZABnlMK+gDJgB8KS77cQxBqxnZ5/pEQS7AnGpl49fI0ZI0w9FIlsmWdCE+5JPi n6WFCA6QdvwfTCv8ZS6Zi9f8EtOTV9UzkRHLtKJjZTiiEIYg9CdHbc161VKfuwet Vlwp0EiwoRGPK9GHf4xfwC2ZhU9tjMTB76/HIqLD+bI1GZxZEH3filICL6NC63fR WoRHeITJkdWIssc6Cpdj2Kn33yHg/AD0tG21R2IZspCQxN8yytC917xnZ+iI8b+k 5eySGqseChwC34D4eCiystbsWlbtOo2Y+jT1InVW/n838nx164TBqmRdI7rGA7Vm ztPn2Wh9VnUrqfrx/yYS1XDcYw/rFgsEkXQw2xXXPTjv8WocR518K+dygHl+FKw+ H3eH7aR5+tMgxgjb1DUGgK1e1OUc1CfrA0LMw906LISOSvITnqi43WIkp291LLAl wGrd4VHWxxTiEhtwis6cYZ7pRiy2P7mtmWLSN0Sx6bEWyVTo7WUEShlIZu1Qx+7f NcPe9FOOQdZRWm19nvrgpjRHYKoiTW+YO3sSbJa5zwtjCQzsUZmUfWI331MkD9VU quotwWFA0eOSUci2jt4EZrAlwtdYVyyhcb4g3v/Q2pAdocVhC7xjENYAfnUUyZdG gy04vEECEy5cxRJM3NCaRfVGTE2j9X4kZ+WTr2E0U8mBSlYHb64dRpjZiigs7VZJ wg5Yzacd5iUgJd/6+DQCEP+/C3yWJI7DVfiM34B8fL53W2MGXAn8gRuqDItckt0+ c8cTYSlr37AIlCDUptCgrJeDsNB+E040waVgRxh1ihvcCU2dNENAXHO5iKc6sG1f ckCaSVob7xsi4IfiY5qJ3R0FCGt5YQ8RFNqrVxzxqB9v/8Kah9FtgoyNkXXe7kMT pT7KRHaibh986ZatTF5Xkfy6Lb5D4QhB5ZZ0LSxmZMFAJB4NsmA/3+aHGae6maz5 9NRbet7y/on2ZHycoPNWZzd045rvzn4FGST1wt4oMJTsAqRetuhxNwm3tLMbS7jR WR7qfAXuzRtpVzv5ol3wGWUTQsOlvrGgyr2HrA8YsGyqYINOK+uInYJF4pHeTh0O yZxDJ+LMBHrTlJo/j9be8+8S5HOHupBYnXCxX+KeN9dSl3gvf7+3QB66VZWTqGAY qoBvh3TB3UUaJL7tV5a7KlCJDCTMgxFv284/3s377zeWtTvsj6RajsKzrSyMsnCG J4yA0DGNuvZqNuBMR2NdGPTF8LJLYLJEZmyv/1DtaPQLqgFVSyDe4F8786QBT9JF zE1mqimjfYQiHhRZiP0U+sA+q3H/tVWzYmww5rDPCvh2TxMovLM5DtKljltG74B5 5zKa1uFlrmuWhppyRcDhjOGcVKxXib3n6s3ITnzdqeYTjip6Ipy8vk0Vp9JdHcq2 AihHN7QFPWHb+iJoPHqHCx3gu58nlQgEoNTyOxMoV3Wio6TlHaf/EQ1MsKo4Uxb9 PDQOEdVPQqr6ap5JWPwaKA== -- /file

dzieko avatar Jun 05 '19 08:06 dzieko

I've had to sightly change the above output to be able to decrypt it.

Anyway, the folders are correctly mapped. However, they do not appear in the synced folders in the logs after the structure comparison/copy.

Is it possible that these folders are filtered in your conf file? Did you paste the full configuration file here?

nicolas33 avatar Jun 05 '19 22:06 nicolas33

I have used the config file as exactly posted above (just with correct credentials). :(

dzieko avatar Jun 06 '19 09:06 dzieko

I just connected via IMAP with thunderbird and I can access all folders and emails.

dzieko avatar Jun 06 '19 09:06 dzieko

Hello Team,

I'm still facing this issue but I spotted something:

One of the labels that was silently skipped by OfflineIMAP was: wakacje/2021.12-barcelona

I renamed it to: wakacje/2021_12-barcelona

Note: I replaced a dot with underscore.

Both label and emails were downloaded correctly!

Are you willing to do live debugging over zoom/team viewer/webex?

cheers! ps.

OfflineIMAP 7.3.4
  Licensed under the GNU GPL v2 or any later version (with an OpenSSL exception)
imaplib2 v2.101 (bundled), Python v2.7.18, OpenSSL 1.1.1l  24 Aug 2021

dzieko avatar Dec 18 '21 17:12 dzieko

"fixed" by adding: sep = / to localrepository config entry.

dzieko avatar Dec 21 '21 08:12 dzieko