Export with structure broken

[tomsaul]

Sometime after early October the 'Export all the folders (with Structure)' option has stopped working - I no longer get the SBD subfolders and their respective content when I do the export.

Currently running TB 91.4 - not sure what version it was when this started, but would have been fairly recent.

Edit: This is only occuring at the 'Account Export' level. Export of individual folders was still working.

[skoufaki]

I have the same issue

[Trogged]

I too have the same issue, although it looks like the feature has been removed? Running TB 91.8.1 .

[cleidigh]

All I am working through things catching up from my personal hiatus. You can track the upcoming maintenance release here:

• #338

With win10, TB91.11 and IETNG 12.0.1 I can successfully export with structure. Can we further define and diagnose the issue? @cleidigh

[tomsaul]

The issue is still present in TB 102. Win 10 and IETNG 12.0.1. I have a mix of POP3 and IMAP accounts, and when I last tested none of them work as expected. I get the base folder export, but no SBD file with the sub-folders.

[cleidigh]

@tomsaul Ok so our setup on Windows matches up. I have not done a POP test lately, but you have issues with IMAP as well. Let's start with the simplest scenario and I presume I will need some debug to find the difference we have. Are you transitioned to 102? There were several issues with MSF files so I would prefer to try and work on that other wise we have an experiment with two variables. @cleidigh

[tomsaul]

TB Ver is 102.1.0 (64 bit). I just checked and it still occurs in all account types. Let me know what info you need.

[cleidigh]

@tomsaul So i assume we need to work with 102. Have you looked at the console output for any errors? @cleidigh

[tomsaul]

I'm not really familiar with the tool, but at first glance zero output when I trigger the export.

[cleidigh]

@tomsaul ok that's surprising I will add some debug so we can see where it goes south. I will post when I have something. @cleidigh

[cleidigh]

@tomsaul Grab b3 from

• #338

Open and clear the log Do a simple export with just a couple of subfolders In console Use right click /copy all and post as a txt file @cleidigh

[tomsaul]

14:44:32.483 Start: ExportFolders (mbox) mboximport.js:768:10 14:44:32.484 Subfolders: true mboximport.js:771:10 14:44:32.484 Structured: true mboximport.js:772:10 14:44:32.484 Local: true mboximport.js:773:10 14:44:32.485 Zip: false mboximport.js:774:10 14:44:32.485 Array [ XPCWrappedNative_NoHelper ] mboximport.js:775:10 14:44:33.673 This page is in Quirks Mode. Page layout may be impacted. For Standards Mode use “”. 2 blank 14:44:38.402 Using exportSingleLocaleFolder mboximport.js:806:11 14:44:38.403 Start: exportSingleLocaleFolder mboximport.js:867:10 14:44:38.403 SrcPath: C:\Users\Tom\AppData\Roaming\Thunderbird\Profiles\5546lc5t.default-release\ImapMail\fatsheepfarm.com mboximport.js:868:10 14:44:38.403 Folder: FSF - Tom mboximport.js:869:10 14:44:38.404 Exporting server mboximport.js:874:11

[cleidigh]

@tomsaul

It looks like you are exporting at the server level versus a folder level. Of course I did not add debug there. Have you tried a folder under the server or am I missing something? @cleidigh

[tomsaul]

Here is a Folder export dump. With that said, the problem I have had is at the server level.

Start: ExportFolders (mbox) mboximport.js:768:10 15:00:34.535 Subfolders: true mboximport.js:771:10 15:00:34.535 Structured: true mboximport.js:772:10 15:00:34.536 Local: true mboximport.js:773:10 15:00:34.536 Zip: false mboximport.js:774:10 15:00:34.536 Array [ XPCWrappedNative_NoHelper ] mboximport.js:775:10 15:02:29.507 Using exportSingleLocaleFolder mboximport.js:806:11 15:02:29.508 Start: exportSingleLocaleFolder mboximport.js:867:10 15:02:29.508 SrcPath: C:\Users\Tom\AppData\Roaming\Thunderbird\Profiles\5546lc5t.default-release\ImapMail\fatsheepfarm.com\INBOX-1 mboximport.js:868:10 15:02:29.508 Folder: Inbox mboximport.js:869:10 15:02:29.508 Exporting with subfolders mboximport.js:887:11 15:02:29.511 Uncaught Exception { name: "NS_ERROR_FILE_NOT_FOUND", message: "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIFile.remove]", result: 2152857618, filename: "chrome://mboximport/content/mboximport/mboximport.js", lineNumber: 1035, columnNumber: 0, data: null, stack: "findGoodFolderName@chrome://mboximport/content/mboximport/mboximport.js:1035:14\nexportSingleLocaleFolder@chrome://mboximport/content/mboximport/mboximport.js:888:13\nexportfolder@chrome://mboximport/content/mboximport/mboximport.js:808:28\noncommand@chrome://messenger/content/messenger.xhtml:1:13\n", location: XPCWrappedNative_NoHelper } mboximport.js:1035

​

[cleidigh]

@tomsaul So we have an error trying to get a unique dest name. odd, will have to add debug there. The src says INBOX-1 did you name it that? Can you create and export a folder UNDER inbox with a couple of subfolders. I am wondering about the root folder somehow being the issue. Ill think about more debug. @cleidigh

[tomsaul]

Here is log with export of subfolder with sub-folders. This did work, and the sbd folders were created.

Concerning naming, I did not explicitly name my Inbox that (and it shows simply as 'Inbox' in UI). These accounts have been in existencce for years, and MANY generations of TB - no clue why they have the '-1' added to the folder names.

15:44:06.190 Start: ExportFolders (mbox) mboximport.js:768:10 15:44:06.191 Subfolders: true mboximport.js:771:10 15:44:06.191 Structured: true mboximport.js:772:10 15:44:06.191 Local: true mboximport.js:773:10 15:44:06.192 Zip: false mboximport.js:774:10 15:44:06.192 Array [ XPCWrappedNative_NoHelper ] mboximport.js:775:10 15:44:11.670 Using exportSingleLocaleFolder mboximport.js:806:11 15:44:11.671 Start: exportSingleLocaleFolder mboximport.js:867:10 15:44:11.671 SrcPath: C:\Users\Tom\AppData\Roaming\Thunderbird\Profiles\5546lc5t.default-release\ImapMail\fatsheepfarm.com\INBOX-1.sbd\Land mboximport.js:868:10 15:44:11.672 Folder: Land mboximport.js:869:10 15:44:11.672 Exporting with subfolders mboximport.js:887:11 15:44:11.673 Land mboximport.js:889:11 15:44:11.673 Copy Land mboximport.js:891:12 15:44:11.935 Copied: C:\Users\Tom\AppData\Roaming\Thunderbird\Profiles\5546lc5t.default-release\ImapMail\fatsheepfarm.com\INBOX-1.sbd\Land.sbd mboximport.js:908:12 15:44:11.936 Msf scan mboximport.js:912:12 15:44:11.937 Array(4) [ XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper ] mboximport.js:913:12 15:44:11.938 Scan: Good mboximport.js:915:13 15:44:11.939 Scan: Good.msf mboximport.js:915:13 15:44:11.939 Create: Good.msf mboximport.js:924:15 15:44:11.939 Scan: Partial mboximport.js:915:13 15:44:11.940 Scan: Partial.msf mboximport.js:915:13 15:44:11.940 Create: Partial.msf mboximport.js:924:15

[cleidigh]

Good, that's baseline. So we should be able to export inbox (moving up) Make sure to export to an empty dir btw my eye gaze is locking up so if i dissappear that is why...

[tomsaul]

Here is the dump starting at 'Inbox' - seems to be correct output for this as well

09:06:19.060 Start: ExportFolders (mbox) mboximport.js:768:10 09:06:19.061 Subfolders: true mboximport.js:771:10 09:06:19.061 Structured: true mboximport.js:772:10 09:06:19.061 Local: true mboximport.js:773:10 09:06:19.062 Zip: false mboximport.js:774:10 09:06:19.062 Array [ XPCWrappedNative_NoHelper ] mboximport.js:775:10 09:06:21.875 Using exportSingleLocaleFolder mboximport.js:806:11 09:06:21.876 Start: exportSingleLocaleFolder mboximport.js:867:10 09:06:21.876 SrcPath: C:\Users\Tom\AppData\Roaming\Thunderbird\Profiles\5546lc5t.default-release\ImapMail\fatsheepfarm.com\INBOX-1 mboximport.js:868:10 09:06:21.876 Folder: Inbox mboximport.js:869:10 09:06:21.876 Exporting with subfolders mboximport.js:887:11 09:06:21.877 Inbox mboximport.js:889:11 09:06:21.877 Copy Inbox mboximport.js:891:12 09:06:22.364 Copied: C:\Users\Tom\AppData\Roaming\Thunderbird\Profiles\5546lc5t.default-release\ImapMail\fatsheepfarm.com\INBOX-1.sbd mboximport.js:908:12 09:06:22.366 Msf scan mboximport.js:912:12 09:06:22.366 Array(32) [ XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, XPCWrappedNative_NoHelper, … ] mboximport.js:913:12 09:06:22.370 Scan: Land mboximport.js:915:13 09:06:22.370 Scan: Land.msf mboximport.js:915:13 09:06:22.371 Create: Land.msf mboximport.js:924:15 09:06:22.371 Scan: Land.sbd mboximport.js:915:13 09:06:22.371 Scan: nstmp mboximport.js:915:13 09:06:22.372 Scan: nstmp-1 mboximport.js:915:13 09:06:22.372 Scan: nstmp-10 mboximport.js:915:13 09:06:22.372 Scan: nstmp-11 mboximport.js:915:13 09:06:22.372 Scan: nstmp-12 mboximport.js:915:13 09:06:22.373 Scan: nstmp-13 mboximport.js:915:13 09:06:22.373 Scan: nstmp-14 mboximport.js:915:13 09:06:22.373 Scan: nstmp-15 mboximport.js:915:13 09:06:22.373 Scan: nstmp-16 mboximport.js:915:13 09:06:22.374 Scan: nstmp-17 mboximport.js:915:13 09:06:22.374 Scan: nstmp-18 mboximport.js:915:13 09:06:22.374 Scan: nstmp-19 mboximport.js:915:13 09:06:22.374 Scan: nstmp-2 mboximport.js:915:13 09:06:22.374 Scan: nstmp-20 mboximport.js:915:13 09:06:22.375 Scan: nstmp-3 mboximport.js:915:13 09:06:22.375 Scan: nstmp-4 mboximport.js:915:13 09:06:22.375 Scan: nstmp-5 mboximport.js:915:13 09:06:22.375 Scan: nstmp-6 mboximport.js:915:13 09:06:22.376 Scan: nstmp-7 mboximport.js:915:13 09:06:22.376 Scan: nstmp-8 mboximport.js:915:13 09:06:22.376 Scan: nstmp-9 mboximport.js:915:13 09:06:22.376 Scan: Pics mboximport.js:915:13 09:06:22.376 Scan: Pics.msf mboximport.js:915:13 09:06:22.377 Create: Pics.msf mboximport.js:924:15 09:06:22.377 Scan: Shopping mboximport.js:915:13 09:06:22.378 Scan: Shopping.msf mboximport.js:915:13 09:06:22.378 Create: Shopping.msf mboximport.js:924:15 09:06:22.378 Scan: Good mboximport.js:915:13 09:06:22.379 Scan: Good.msf mboximport.js:915:13 09:06:22.379 Create: Good.msf mboximport.js:924:15 09:06:22.379 Scan: Partial mboximport.js:915:13 09:06:22.380 Scan: Partial.msf mboximport.js:915:13 09:06:22.380 Create: Partial.msf mboximport.js:924:15

[cleidigh]

Good, that was what I expected. The account export has a different execution method and I can see it's broken. I believe I know where so I will work on that. Thanks for the quick testing! @cleidigh

[cleidigh]

@tomsaul Did a new exportAccount using IOUtils the new file api. Looks good, but need polyfill for TB91 and cleanup. Grab b4 from

• #338 @cleidigh

[tomsaul]

Some progress, but it will take me some time to confirm full function. I now see the export occur, including the SBD folders, but all the MSF files are zero bytes long (when there are emails in the respective folder), and offhand I am not seeing MBOX files for all the folders with mail in them (but they might be somewhere less obvious). And FWIW - the content is very different than what I saw in the past (but TB might have had structural changes that lead to this).

[cleidigh]

@tomsaul I am just about done with the required polyfill for 91. I zero out the msf files, they are rebuilt if imported. All my tests include all mboxes as a deep copy is done so missing files would be concerning. I don't understand your statement about "content" @cleidigh

[cleidigh]

Addressed with v12.0.2 Release