Bookmarsk Search Plus 2 gets stuck on "wait background load" and only goes away when I reinstall the extension.

[YousufSSyed]

Idk if this has anything to do with it but I have 16K bookmarks, and I'm on MacOS. What can be done about this problem?

[rjt]

I am no expert. I do not have same exact problem, but I do have performance issues bc i am the bookmark hoarder. 16k lol:)

There are utilities that perform quality control specifically for Bookmarks and SQLite databases in general.
brew search firefox brew search bookmarks

I have been meaning to open the SQLite Bookmarks database directly and find duplicates in the same folder and merge them including tags.

Find mixed use of different Unicode character code pages or ByteOrderMarks.

Regex for unescaped special SQL characters and words. Looking for the single apostrophe especially would be an especially good idea for you.

Programmatically merge duplicate MiXed CaSe tags.

Based on experience that more than 3,000 files in a single folder can cause major performance degradation... It might help to develop a hierarchy and move bookmarks into separate "folders". A-G , H-K, L-R, S-Z. I said might because after opening the db manually, I was frustrated to find that folders and bookmarks are the same records with a different field value. However, it did help initial loading time to move all the root level bookmarks into subfolders.

[aaFn]

Hello, some BSP2 users have more than 80k bookmarks so that should be ok.

To debug this problem, when it happens, use this procedure https://github.com/aaFn/Bookmark-search-plus-2/wiki/Getting-and-providing-logs-for-debugging-BSP2 That should help understand what is happening.

Thank you, aaFn.

[Gitoffthelawn]

Hello, some BSP2 users have more than 80k bookmarks so that should be ok.

You raaaang? ;)

[YousufSSyed]

So I followed the steps in the troubleshooting page, clearing the console log, opening the extension the sidebar, searching for an item, and finally right clicking and selecting "show in folder." This was the only line outputted:

ExtensionPreferencesManager API ftpProtocolEnabled created but addSetting was not called.

This issue should stay open, and when I do have the problem again, I'll follow the steps and reply with the output once more.

[aaFn]

Ok, sure, come back when you get it again and get debug data. If in 1 month from now you do not have anything, I will close it, but you can always reopen it later if it comes after that.

[YousufSSyed]

I thought to see the error again would take up to 3 days or so but I got it only 3 hours later. Notably after restarting macOS and launching Firefox again (which may or may not end up being related to the problem relevant I guess?).

So what happened was, when I started up Firefox and went for the extension in the sidebar, it was stuck on background load. I then restarted Firefox, and started the extension again but cleared console output before doing so. I got the same message as last time:

ExtensionPreferencesManager API ftpProtocolEnabled created but addSetting was not called.

I then disabled the extension, restarted Firefox, opened the console and cleared output, then re-enabled the extension and got this output:

Warning: attempting to write 4145 bytes to preference browser.uiCustomization.state. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes.
ExtensionPreferencesManager API ftpProtocolEnabled created but addSetting was not called.
DataCloneError: Promise object could not be cloned. ExtensionChild.jsm:836
Attempt to override an existing message: "text-action-undo". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-undo-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-redo". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-redo-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-cut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-cut-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-copy". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-copy-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-paste". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-paste-no-formatting". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-paste-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-delete". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-select-all". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-select-all-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-no-suggestions". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-add-to-dictionary". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-undo-add-to-dictionary". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-check-toggle". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-add-dictionaries". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-dictionaries". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-search-text-box-clear". toolkit/global/textActions.ftl
Attempt to override an existing message: "window-minimize-command". browser/browserSets.ftl
Attempt to override an existing message: "window-zoom-command". browser/browserSets.ftl
Attempt to override an existing message: "window-new-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "window-minimize-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "close-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "tab-new-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "location-open-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "location-open-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "search-focus-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "find-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "search-find-again-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "search-find-again-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "search-find-selection-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "search-focus-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "downloads-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "addons-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "file-open-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "save-page-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "page-source-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "page-source-shortcut-safari". browser/browserSets.ftl
Attempt to override an existing message: "page-info-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "print-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "mute-toggle-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "nav-back-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "nav-fwd-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "nav-reload-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "nav-stop-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "history-show-all-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "history-show-all-shortcut-mac". browser/browserSets.ftl
Attempt to override an existing message: "history-sidebar-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-screen-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "reader-mode-toggle-shortcut-windows". browser/browserSets.ftl
Attempt to override an existing message: "reader-mode-toggle-shortcut-other". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut-mac". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut-mac-alt". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-this-page-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-show-library-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-show-sidebar-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-show-toolbar-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reduce-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reduce-shortcut-alt-a". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reduce-shortcut-alt-b". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-enlarge-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-enlarge-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-enlarge-shortcut-alt2". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reset-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reset-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "bidi-switch-direction-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "private-browsing-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "quit-app-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "help-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "preferences-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "hide-app-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "hide-other-apps-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "text-action-undo". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-undo-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-redo". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-redo-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-cut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-cut-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-copy". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-copy-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-paste". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-paste-no-formatting". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-paste-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-delete". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-select-all". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-select-all-shortcut". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-no-suggestions". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-add-to-dictionary". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-undo-add-to-dictionary". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-check-toggle". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-add-dictionaries". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-spell-dictionaries". toolkit/global/textActions.ftl
Attempt to override an existing message: "text-action-search-text-box-clear". toolkit/global/textActions.ftl
Attempt to override an existing message: "window-minimize-command". browser/browserSets.ftl
Attempt to override an existing message: "window-zoom-command". browser/browserSets.ftl
Attempt to override an existing message: "window-new-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "window-minimize-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "close-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "tab-new-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "location-open-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "location-open-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "search-focus-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "find-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "search-find-again-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "search-find-again-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "search-find-selection-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "search-focus-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "downloads-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "addons-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "file-open-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "save-page-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "page-source-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "page-source-shortcut-safari". browser/browserSets.ftl
Attempt to override an existing message: "page-info-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "print-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "mute-toggle-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "nav-back-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "nav-fwd-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "nav-reload-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "nav-stop-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "history-show-all-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "history-show-all-shortcut-mac". browser/browserSets.ftl
Attempt to override an existing message: "history-sidebar-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-screen-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "reader-mode-toggle-shortcut-windows". browser/browserSets.ftl
Attempt to override an existing message: "reader-mode-toggle-shortcut-other". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut-mac". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut-mac-alt". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "picture-in-picture-toggle-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-this-page-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-show-library-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-show-sidebar-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "bookmark-show-toolbar-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reduce-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reduce-shortcut-alt-a". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reduce-shortcut-alt-b". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-enlarge-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-enlarge-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-enlarge-shortcut-alt2". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reset-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "full-zoom-reset-shortcut-alt". browser/browserSets.ftl
Attempt to override an existing message: "bidi-switch-direction-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "private-browsing-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "quit-app-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "help-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "preferences-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "hide-app-shortcut". browser/browserSets.ftl
Attempt to override an existing message: "hide-other-apps-shortcut". browser/browserSets.ftl
DataCloneError: Promise object could not be cloned. 2 ExtensionChild.jsm:836

I actually started writing this right after I got those first 2 messages, and while writing I got all of these error messages. But let me ask: could at least some or the error messages be produced by other extensions?

[YousufSSyed]

I actually decided to look into how to easily disable and enable all extensions at once, and found this Gist (look at disable all add-ons, enable all add-ons, reload active add-ons). So I disabled all add-ons, re-enabled only BSP2, and waited 5 mins (since it took that to see a the bulk of the output in my reply above) and I got just this:

Warning: attempting to write 4145 bytes to preference browser.uiCustomization.state. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes.
ExtensionPreferencesManager API ftpProtocolEnabled created but addSetting was not called.

Looking at my other outputs, this is the only instance of seeing these two messages together, and I can confidently say that this was the output while waiting 5 mins after reloading, and having that be the only extension enabled.

[YousufSSyed]

Wouldn't it be a good idea to add some stuff from the Gist to the debugging guide?

Stuff from the Gist:

Instructions

• Run the required JavaScript code (copy/paste) in a Firefox console:
  • Web Console (best way)
    • open Firefox about:addons page (Ctrl+Shift+A),
      the page titled "Manage Your Extensions"
    • open the Web Console (Ctrl+Shift+K or F12/Console)
  • Browser Console (alternative way)
    • requires Firefox about:config devtools.chrome.enabled set to true
    • open the Firefox Browser Console (Ctrl+Shift+J)

disable all add-ons

/* disable all firefox add-ons */
AddonManager.getAddonsByTypes(["extension"]).then(addons => {
  addons.forEach(addon => {
    if(!(addon.isBuiltin||addon.isSystem)) { addon.disable(); }
  });
});

enable all add-ons

/* enable all firefox add-ons */
AddonManager.getAddonsByTypes(["extension"]).then(addons => {
  addons.forEach(addon => {
    if(!(addon.isBuiltin||addon.isSystem)) { addon.enable(); }
  });
});

reload active add-ons

/* reload active firefox add-ons */
AddonManager.getActiveAddons(["extension"]).then(({addons}) => {
  addons.forEach(addon => {
    if(!(addon.isBuiltin||addon.isSystem||addon.hidden)) addon.reload();
  });
});

[YousufSSyed]

I am no expert. I do not have same exact problem, but I do have performance issues bc i am the bookmark hoarder. 16k lol:)

There are utilities that perform quality control specifically for Bookmarks and SQLite databases in general. brew search firefox brew search bookmarks

I have been meaning to open the SQLite Bookmarks database directly and find duplicates in the same folder and merge them including tags.

Find mixed use of different Unicode character code pages or ByteOrderMarks.

Regex for unescaped special SQL characters and words. Looking for the single apostrophe especially would be an especially good idea for you.

Programmatically merge duplicate MiXed CaSe tags.

Based on experience that more than 3,000 files in a single folder can cause major performance degradation... It might help to develop a hierarchy and move bookmarks into separate "folders". A-G , H-K, L-R, S-Z. I said might because after opening the db manually, I was frustrated to find that folders and bookmarks are the same records with a different field value. However, it did help initial loading time to move all the root level bookmarks into subfolders.

@rjt

What's brew search firefox and brew search bookmarks? Are those homebrew commands? I have homebrew installed.

[aaFn]

Thank you. Strange, I see no add-on specific message, neither BSP2 nor the others. And the Dataclone error, plus the one on "preference" don't look good, in general that means that there is corruption in your Firefox local store 😞

For lack of anything else, I would suggest that you uninstall BSP2, then reinstall it. That should clean up the FF local storage for BSP2. Note: the reasons for corruption are unknown, but they are Firefox related as I see it, because the add-on has no control on local storage, it can only read and write, through FF API calls -> no way for the add-on to mess up the store.

[aaFn]

Closing the issue for now since no activity on it since October. Please reopen if more information / new elements to bring to investigate.

Thank you, aaFn.