Thunderbird 102 compatibility issue?

[ctft1]

Hi,

Since Thunderbird 102 upgrade, I have some issues with folders (I have hundreds of them)

The remove duplicate function works fine once, and the folder seems to be broken (folder summary seems gone, and a new click on the folder will generate the new summary) ... Anyone else having such behavior?

Thank you!

[eyalroz]

The switch to TB 102 should not have affected you...

What do you mean by "folder summary gone"?

Anyway, there have been a lot of bugs reported by people with the switch to TB 102, regardless of the removedupes extension, see: https://mzl.la/3zWDIrt

[ctft1]

Thank you for your quick answer. Yes actually I upgraded by mistake, usually I wait for a few month after a major release, but I cannot downgrade now..

"folder summary gone" means when I click on the folder to view the content, it has to rebuild the "folder summary" (which can take a few seconds on big folders + breaks the message filters in some case), even if it was already build. This also happens when closing / opening TB.

I had 2 extensions that were concerned with this behavior (enabling them cause the issue, so I disabled them) :

• Remove Duplicate
• QuickFoders

So yes, maybe there is something wrong in TB102 with extensions that screens the files? I've read about "inbox corruption" bug, so yes again, I'm not sure this version was stable enough for a realease..

I should do more testing, but as my thunberbird is handling 10+emails, 500+ folders, and 30+GB data, each time it "breaks" it takes forever to rebuild..

[eyalroz]

I first want to ask you to make sure you've updated to v102.0.1 (that's two updates since the TB 102 release - 102.0 then 102.0.1).

Then, I'd like to ask you to try and reproduce this issue with a new account, and write down the steps you take until you see the "folder summary" get rebuilt (i.e. not built the first time you access a folder, but after a disappearance).

Still, it is likely I would not be able to do anything about it. You see, my extensions doesn't actually do anything with messages itself. It only tells Thunderbird: "Here is a list of messages; please move them to the trash folder" or "please erase them". It's a TB internal service which does this.

[eyalroz]

Apparently, this bug:

https://bugzilla.mozilla.org/show_bug.cgi?id=1773822

might be the culprit.

[Betterbird]

Some background. TB 102 migrates the old "folder cache" stored in a Mork database panacea.dat to a new JSON format, folderCache.json. It is still unclear whether this migration is fully functional, but observer behaviour is this:

1. The folder cache fails to flush: https://bugzilla.mozilla.org/show_bug.cgi?id=1774072
2. Extensions that retrieve properties of a lot of folders, like "Quick Folder Move" (QFM) that retrieves the MRUTime, need to open a lot of folders since the property is missing in the folder cache for many folders. Opening more than about 500 folders on Windows reaches the number of maximum open files. Opening more folders/MSFs leads to errors and TB in turn deleted the MSF it couldn't open leading to the observed mass exodus. We've seen 800+ MSFs disappear in a single use of QFM. This was mitigated in https://bugzilla.mozilla.org/show_bug.cgi?id=1773822 since property retrieval now again closes the folder database.
3. Retrieving a property missing from the folder cache for a subsequently failed to store the just retrieved value in the cache, https://bugzilla.mozilla.org/show_bug.cgi?id=1776280.

The Betterbird team found and fixed all three problems, the fixes for 1. and 2. are in TB 102.0.1, all three fixes are of course in Betterbird, see our release notes (they don't mention 1. and 2. any more since this is fixed everywhere now).

Altogether a bitter aftertaste remains since TB release quality has been really poor. Additionally, it's not clear whether there is a persistent issue with the panacea.dat to folderCache.json migration for profiles with many folders. Sadly panacea.dat is removed during the migration and all our backups had been overwritten before noticing the issue. Furthermore, panacea.dat is difficult to read, so it's not clear whether all the MRUTime properties were present or not.

EDIT: Slowly the picture is becoming clear, the changed "null retrieval" behaviour of the folder cache is causing all this: https://bugzilla.mozilla.org/show_bug.cgi?id=1776280#c7 https://bugzilla.mozilla.org/show_bug.cgi?id=1776280#c9

[eyalroz]

@ctft1 : Do you still see this problem?