my SOLR read and write is very slow

[Agent253]

Hi,

I have a problem with my Solr database. I have a core with around 50 millions documents (split in 4 shards) and it's extremely slow.

It takes around 50 seconds for 1000 new documents to be committed and I frequently get this error:

Task queue processing has stalled for 20195ms with 0 remaining elements to process. (When I get this error, my documents aren't committed)

In read mode, a simple query takes a long time:

• With a q=*:* and rows=10, it takes 776ms to get a response (Maybe it's because I didn't use the shard key ?)
• When I filter a simple id like that objectId: 1234 and shard key _route_=abcd!, it takes around 100ms to get a response

My schema and config core :

• I have the indexes only for each field I filter (the description is not filtered so I didn't set an index on it)
• I have enabled the LazyFieldLoading to lazy load some not indexed fields (like a description with a big string)
• My core is split in 4 shards and I set the shard key on the id like this: abcd!1234 (So the shard key is abcd!)
• I set this filterCache :

<filterCache class="org.apache.solr.search.CaffeineCache" maxRamMB="1000" autowarmCount="128"/>

If anyone has an idea why Solr is so slow, I'd greatly appreciate it

[vladiceanu]

This does not seem a Solr Operator issue, perhaps makes sense to migrate this issue to Solr Jira workspace or ask the community.