import-export-tools-ng icon indicating copy to clipboard operation
import-export-tools-ng copied to clipboard

Messages missing in exported mbox file from IMAP folder

Open paulmenzel opened this issue 10 months ago • 4 comments

Debian sid/unstable with thunderbird 1:128.6.0esr-1 and ImportExportTools NG 14.1.4

In IMAP account there is a folder Archive/x with 64,000 messages, and, to be sure, I selected all messages and choose to download them for offline use using the context menu. The Thunderbird properties show the folder uses up around 650 MB of space. Then exporting this folder to a single mbox file, after over an hour only a file of size 382 MB is created, and it stays there. Checking for some message ids, I found some of them missing.

paulmenzel avatar Feb 01 '25 10:02 paulmenzel

@paulmenzel Thanks for the post. I'm thinking that the messages are really not fully synced. I say this because in my experience I see with my accounts and with various users. One recent example is a user also with about 60k messages with a size of 10GB. My mixed business and personal account currently has 27k messages with a size of 2.5GB. So far your 60k messages they would have to be dramatically tiny to result in 650MB. I just don't see that as statistically likely.

So I really think it's not totally synced. Can you capture the debug output and post? I would like to see the message id errors you refer to. Thanks @clokep

cleidigh avatar Feb 02 '25 20:02 cleidigh

@paulmenzel Thanks for the post. I'm thinking that the messages are really not fully synced. I say this because in my experience I see with my accounts and with various users. One recent example is a user also with about 60k messages with a size of 10GB. My mixed business and personal account currently has 27k messages with a size of 2.5GB. So far your 60k messages they would have to be dramatically tiny to result in 650MB. I just don't see that as statistically likely.

It’s just Gerrit messages (only text/plain), so 650 MB is correct (and from Thunderbirds dialog) and also shown by the email provider. The 382 MB export file is too small though.

So I really think it's not totally synced. Can you capture the debug output and post? I would like to see the message id errors you refer to. Thanks @clokep

Unfortunately, searching for debug in the README did not show me how to do this. Could you please point me to the documentation?

paulmenzel avatar Feb 02 '25 21:02 paulmenzel

@paulmenzel I'm not familiar with Gerrit and a search didn't show something relevant. But I will take your word. Apologize for assuming you were familiar with the console. Use shift-control-J Clear with trash can do export back to console right click save all to file post here @cleidigh

cleidigh avatar Feb 02 '25 22:02 cleidigh

@paulmenzel I should have a beta tomorrow which should catch message errors and both write them to the console as well as error messages in the exported messages with from, to, date, subject (with error prefix) if available. Would you be able to try it on your folder? @cleidigh

cleidigh avatar Feb 07 '25 00:02 cleidigh