elasticsuite icon indicating copy to clipboard operation
elasticsuite copied to clipboard

Using Elasticsearch in Backend / Product Filtering with 3.000.000 Products

Open phpsyscoder opened this issue 7 years ago • 4 comments

Dear Team (its a "Question-only-Issue" )

we using Mage2 with 3.000.000 Products... Elasticsearch did a great job... very fast.

But the Build-in Backend Seach/Filtering for the Products is - of course - very slow, our customer have to wait up to some minutes for ie filtering by "Product Name".

Is it possible to use the Elasticsearch-Engine for the Backend-Product Search also?

Any Help/Tips are welcome

Greetings Hans-Jürgen Petrich

phpsyscoder avatar Oct 20 '17 22:10 phpsyscoder

@petrich thank you for submitting this request.

This is something we also noticed by our side, on a project of a similar size as yours.

It would seem quite easy to plug Elasticsearch for product grids in Backend at first sight, but there are some issues :

  • some fields are coming from SQL joins (Eg the "qty" field).

  • not all products are indexed into Elasticsearch : simple products are not, which would make them disappear from the grid

We were thinking about having a second index dedicated to the grid but this causes quite a duplication of data between the "search" and the "grid" index.

But this is a point we definitely plan to address.

Best regards

romainruaud avatar Oct 23 '17 09:10 romainruaud

How about using shared Catalog theory to make a ZERO group ID filter for backend and ONE group ID for default front-end to import all products?

@petrich - you must modify grid collection search to use index not like '%'+term+'%' with wildcard on both sides to not use full table scan!

southerncomputer avatar Oct 23 '17 10:10 southerncomputer

I guess a partial implementation, on fulltext search only (which is the slowest, with that union all sql query), could already help a lot.

Nuranto avatar Nov 16 '22 08:11 Nuranto

Dear Team (its a "Question-only-Issue" )

we using Mage2 with 3.000.000 Products... Elasticsearch did a great job... very fast.

But the Build-in Backend Seach/Filtering for the Products is - of course - very slow, our customer have to wait up to some minutes for ie filtering by "Product Name".

Is it possible to use the Elasticsearch-Engine for the Backend-Product Search also?

Any Help/Tips are welcome

Greetings Hans-Jürgen Petrich

And how many attributes and filters do you have?

Mobecls avatar May 15 '23 12:05 Mobecls