Price indexer running for multiple hours with 2.1 million products

[ioweb-gr]

Preconditions and environment

• 2.4.5-p2

Steps to reproduce

We have created a website with 45974 configurable products and a total of 2.1 million products with their variations + simple products

Reindexing process crashed in scheduled mode and for some reasons and we need to reindex them fully.

Unexpectedly though the reindex process runs for too many hours for the price indexer and this leads to products not displaying in the frontend as in order to reindex the catalog search index and the category products index, the price index must run as well but it takes too long.

Now our frontend is missing products

Is magento even able to handle the 2.1m products? What can I do to make it run faster? Changing the batch size has no effect whatsoever, the speed is horribly slow.

Expected result

All indexers run fast.

Actual result

Reindexing is slow.

Additional information

No response

Release note

No response

Triage and priority

• [x] Severity: S0 - Affects critical data or functionality and leaves users without workaround.
• [ ] Severity: S1 - Affects critical data or functionality and forces users to employ a workaround.
• [ ] Severity: S2 - Affects non-critical data or functionality and forces users to employ a workaround.
• [ ] Severity: S3 - Affects non-critical data or functionality and does not force users to employ a workaround.
• [ ] Severity: S4 - Affects aesthetics, professional look and feel, “quality” or “usability”.