manticoresearch
manticoresearch copied to clipboard
Published
20 hours ago •
manticoresoftware
manticoresoftware
pseudo_sharding with query match
Describe the bug When query with many values in part match (more than 434) there is a crash
To Reproduce Config
source src_idx_0 {
type = csvpipe
csvpipe_delimiter = |
csvpipe_command = php /home/manticore/generate_data.php
csvpipe_field_string = id
csvpipe_field_string = producer_id
}
index idx_0 {
source = src_idx_0
path = /var/lib/manticore/data/idx_0
}
searchd {
listen = 9312
listen = 9306:mysql41
log = /var/log/manticore/searchd.log
query_log = /var/log/manticore/query.log
query_log_format = sphinxql
pid_file = /var/run/manticore/searchd.pid
binlog_path = /var/lib/manticore/data
# pseudo_sharding = 0
}
cvs script
<?php
function generateIntToString($to)
{
return rand(0, $to) . "";
}
for ($n = 1; $n <= 10000; $n++) {
printf(
"%s|%s\n",
generateIntToString(1000), // id
generateIntToString(1000) // producer_id
);
}
query
SELECT id FROM `idx_0` WHERE (MATCH('(@producer_id 1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55|56|57|58|59|60|61|62|63|64|65|66|67|68|69|70|71|72|73|74|75|76|77|78|79|80|81|82|83|84|85|86|87|88|89|90|91|92|93|94|95|96|97|98|99|100|101|102|103|104|105|106|107|108|109|110|111|112|113|114|115|116|117|118|119|120|121|122|123|124|125|126|127|128|129|130|131|132|133|134|135|136|137|138|139|140|141|142|143|144|145|146|147|148|149|150|151|152|153|154|155|156|157|158|159|160|161|162|163|164|165|166|167|168|169|170|171|172|173|174|175|176|177|178|179|180|181|182|183|184|185|186|187|188|189|190|191|192|193|194|195|196|197|198|199|200|201|202|203|204|205|206|207|208|209|210|211|212|213|214|215|216|217|218|219|220|221|222|223|224|225|226|227|228|229|230|231|232|233|234|235|236|237|238|239|240|241|242|243|244|245|246|247|248|249|250|251|252|253|254|255|256|257|258|259|260|261|262|263|264|265|266|267|268|269|270|271|272|273|274|275|276|277|278|279|280|281|282|283|284|285|286|287|288|289|290|291|292|293|294|295|296|297|298|299|300|301|302|303|304|305|306|307|308|309|310|311|312|313|314|315|316|317|318|319|320|321|322|323|324|325|326|327|328|329|330|331|332|333|334|335|336|337|338|339|340|341|342|343|344|345|346|347|348|349|350|351|352|353|354|355|356|357|358|359|360|361|362|363|364|365|366|367|368|369|370|371|372|373|374|375|376|377|378|379|380|381|382|383|384|385|386|387|388|389|390|391|392|393|394|395|396|397|398|399|400|401|402|403|404|405|406|407|408|409|410|411|412|413|414|415|416|417|418|419|420|421|422|423|424|425|426|427|428|429|430|431|432|433|434|435)'));
Describe the environment:
Manticore 5.0.2 348514c86@220530 dev (columnar 1.15.4 2fef34e@220522) (secondary 1.15.4 2fef34e@220522)OS version: Debian GNU/Linux 10 (buster) Linux 4.19.0-14-amd64
Additional context
If you set value pseudo_sharding = 0 will not crash.
Created a repository https://github.com/vilnar/manticoresearch-issue-886, there is README.md which has steps to reproduce issue.
could you provide crash log with BT of the crash to make sure that we will reproduce the same crash as you reported?
is it a crash or OOM killer?
Reproduced in the latest commit:
mysql> SELECT id FROM `idx_0` WHERE (MATCH('(@producer_id 1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55|56|57|58|59|60|61|62|63|64|65|66|67|68|69|70|71|72|73|74|75|76|77|78|79|80|81|82|83|84|85|86|87|88|89|90|91|92|93|94|95|96|97|98|99|100|101|102|103|104|105|106|107|108|109|110|111|112|113|114|115|116|117|118|119|120|121|122|123|124|125|126|127|128|129|130|131|132|133|134|135|136|137|138|139|140|141|142|143|144|145|146|147|148|149|150|151|152|153|154|155|156|157|158|159|160|161|162|163|164|165|166|167|168|169|170|171|172|173|174|175|176|177|178|179|180|181|182|183|184|185|186|187|188|189|190|191|192|193|194|195|196|197|198|199|200|201|202|203|204|205|206|207|208|209|210|211|212|213|214|215|216|217|218|219|220|221|222|223|224|225|226|227|228|229|230|231|232|233|234|235|236|237|238|239|240|241|242|243|244|245|246|247|248|249|250|251|252|253|254|255|256|257|258|259|260|261|262|263|264|265|266|267|268|269|270|271|272|273|274|275|276|277|278|279|280|281|282|283|284|285|286|287|288|289|290|291|292|293|294|295|296|297|298|299|300|301|302|303|304|305|306|307|308|309|310|311|312|313|314|315|316|317|318|319|320|321|322|323|324|325|326|327|328|329|330|331|332|333|334|335|336|337|338|339|340|341|342|343|344|345|346|347|348|349|350|351|352|353|354|355|356|357|358|359|360|361|362|363|364|365|366|367|368|369|370|371|372|373|374|375|376|377|378|379|380|381|382|383|384|385|386|387|388|389|390|391|392|393|394|395|396|397|398|399|400|401|402|403|404|405|406|407|408|409|410|411|412|413|414|415|416|417|418|419|420|421|422|423|424|425|426|427|428|429|430|431|432|433|434|435)'));
ERROR 2013 (HY000): Lost connection to MySQL server during query
No connection. Trying to reconnect...
ERROR 2003 (HY000): Can't connect to MySQL server on '0:9317' (111)
ERROR:
Can't connect to the server
mysql> show status like '%version%';
No connection. Trying to reconnect...
Connection id: 1
Current database: *** NONE ***
+---------------+-----------------------------------------------------------------------------------------------+
| Counter | Value |
+---------------+-----------------------------------------------------------------------------------------------+
| version | 5.0.3 0a85863ff@220908 dev (columnar 1.16.1 ff9631d@220908) (secondary 1.16.1 ff9631d@220908) |
| mysql_version | 5.0.3 0a85863ff@220908 dev (columnar 1.16.1 ff9631d@220908) (secondary 1.16.1 ff9631d@220908) |
+---------------+-----------------------------------------------------------------------------------------------+
2 rows in set (0.00 sec)
mysql> set global pseudo_sharding = 0;
Query OK, 0 rows affected (0.00 sec)
mysql> SELECT id FROM `idx_0` WHERE (MATCH('(@producer_id 1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55|56|57|58|59|60|61|62|63|64|65|66|67|68|69|70|71|72|73|74|75|76|77|78|79|80|81|82|83|84|85|86|87|88|89|90|91|92|93|94|95|96|97|98|99|100|101|102|103|104|105|106|107|108|109|110|111|112|113|114|115|116|117|118|119|120|121|122|123|124|125|126|127|128|129|130|131|132|133|134|135|136|137|138|139|140|141|142|143|144|145|146|147|148|149|150|151|152|153|154|155|156|157|158|159|160|161|162|163|164|165|166|167|168|169|170|171|172|173|174|175|176|177|178|179|180|181|182|183|184|185|186|187|188|189|190|191|192|193|194|195|196|197|198|199|200|201|202|203|204|205|206|207|208|209|210|211|212|213|214|215|216|217|218|219|220|221|222|223|224|225|226|227|228|229|230|231|232|233|234|235|236|237|238|239|240|241|242|243|244|245|246|247|248|249|250|251|252|253|254|255|256|257|258|259|260|261|262|263|264|265|266|267|268|269|270|271|272|273|274|275|276|277|278|279|280|281|282|283|284|285|286|287|288|289|290|291|292|293|294|295|296|297|298|299|300|301|302|303|304|305|306|307|308|309|310|311|312|313|314|315|316|317|318|319|320|321|322|323|324|325|326|327|328|329|330|331|332|333|334|335|336|337|338|339|340|341|342|343|344|345|346|347|348|349|350|351|352|353|354|355|356|357|358|359|360|361|362|363|364|365|366|367|368|369|370|371|372|373|374|375|376|377|378|379|380|381|382|383|384|385|386|387|388|389|390|391|392|393|394|395|396|397|398|399|400|401|402|403|404|405|406|407|408|409|410|411|412|413|414|415|416|417|418|419|420|421|422|423|424|425|426|427|428|429|430|431|432|433|434|435)'));
+------+
| id |
+------+
| 808 |
| 981 |
| 67 |
| 679 |
| 250 |
| 940 |
| 404 |
| 236 |
| 822 |
| 903 |
| 841 |
| 436 |
| 546 |
| 0 |
| 670 |
| 359 |
| 401 |
| 60 |
| 978 |
| 260 |
+------+
20 rows in set (0.02 sec)
Crashlog:
[Fri Sep 9 05:04:23.465 2022] [3859094] preread 1 indexes in 0.000 sec
------- FATAL: CRASH DUMP -------
[Fri Sep 9 05:04:23.966 2022] [3859090]
--- crashed SphinxQL request dump ---
SELECT id FROM `idx_0` WHERE (MATCH('(@producer_id 1|2|3|4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|4
4|45|46|47|48|49|50|51|52|53|54|55|56|57|58|59|60|61|62|63|64|65|66|67|68|69|70|71|72|73|74|75|76|77|78|79|80|81|82|83|84|85|86|87|88|89|90|91|92|93|94|95|96|97|98|99|100|1
01|102|103|104|105|106|107|108|109|110|111|112|113|114|115|116|117|118|119|120|121|122|123|124|125|126|127|128|129|130|131|132|133|134|135|136|137|138|139|140|141|142|143|1
44|145|146|147|148|149|150|151|152|153|154|155|156|157|158|159|160|161|162|163|164|165|166|167|168|169|170|171|172|173|174|175|176|177|178|179|180|181|182|183|184|185|186|1
87|188|189|190|191|192|193|194|195|196|197|198|199|200|201|202|203|204|205|206|207|208|209|210|211|212|213|214|215|216|217|218|219|220|221|222|223|224|225|226|227|228|229|2
30|231|232|233|234|235|236|237|238|239|240|241|242|243|244|245|246|247|248|249|250|251|252|253|254|255|256|257|258|259|260|261|262|263|264|265|266|267|268|269|270|271|272|2
73|274|275|276|277|278|279|280|281|282|283|284|285|286|287|288|289|290|291|292|293|294|295|296|297|298|299|300|301|302|303|304|305|306|307|308|309|310|311|312|313|314|315|3
16|317|318|319|320|321|322|323|324|325|326|327|328|329|330|331|332|333|334|335|336|337|338|339|340|341|342|343|344|345|346|347|348|349|350|351|352|353|354|355|356|357|358|3
59|360|361|362|363|364|365|366|367|368|369|370|371|372|373|374|375|376|377|378|379|380|381|382|383|384|385|386|387|388|389|390|391|392|393|394|395|396|397|398|399|400|401|4
02|403|404|405|406|407|408|409|410|411|412|413|414|415|416|417|418|419|420|421|422|423|424|425|426|427|428|429|430|431|432|433|434|435)'))
--- request dump end ---
--- local index:idx_0
Manticore 5.0.3 8896d8a23@220823 dev (columnar 1.16.1 7db3493@220802) (secondary 1.16.1 7db3493@220802)
Handling signal 11
-------------- backtrace begins here ---------------
Program compiled with Clang 13.0.1
Configured with flags: Configured with these definitions: -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC
=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ZSTD=1 -DDL_ZSTD=1 -DZSTD_LIB=libzstd.so.1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DW
ITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.21 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTG
RESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore
Built on Linux x86_64
Stack bottom = 0x8e1a04, thread stack size = 0x8e18f9
Trying manual backtrace:
Stack looks OK, attempting backtrace.
[Fri Sep 9 05:04:24.326 2022] [3858978] watchdog: main process 3859090 killed dirtily with signal 11, core dumped, will be restarted
[Fri Sep 9 05:04:24.326 2022] [3858978] watchdog: main process 3859126 forked ok
[Fri Sep 9 05:04:24.327 2022] [3859126] starting daemon version '5.0.3 8896d8a23@220823 dev (columnar 1.16.1 7db3493@220802) (secondary 1.16.1 7db3493@220802)' ...
Crash log from the server where the crash occurred, with flag --logdebug
[Thu Sep 8 15:01:17.509 2022] [93338] DEBUG: prereaded index 'category_84625' in 0.002 sec
[Thu Sep 8 15:01:17.509 2022] [93338] prereaded 20 indexes in 0.567 sec
------- FATAL: CRASH DUMP -------
[Thu Sep 8 15:02:21.517 2022] [93329]
--- crashed SphinxQL request dump ---
SELECT id, IF(IN(tags, 5), 1, 0) AS is_popularity,
IF(seller_id = 5 AND (sell_status
= 'available' OR sell_status = 'limited'), 1,
IF(sell_status = 'available' OR sell_status
= 'limited', 2, IF(seller_id = 5, 4, 5))) as rozetka_top_order,
IF(sell_status = 'waiting_for_supply',
9, 0)+IF(sell_status = 'limited', 2, 0)+IF(sell_status = 'available', 2, 0)+IF(sell_status
= 'out_of_stock', 10, 0)+IF(sell_status = 'unavailable', 11, 0) AS sell_status_order,
IF(state = 'new', 1, 3) as state_order, IF(price > 0, 1,85) as blank_price_order,
(rozetka_top_order * sell_status_order * state_order * blank_price_order) AS total_order
FROM `category_4626923` WHERE (MATCH('(@category_ids .4649052.) (@producer_id 648931|546523|630757|513612|586691|572786|460034|633508|113841|635272|519361|572791|116025|578196|548329|400089|604003|556315|573256|548323|648928|567577|133011|630760|573261|612423|548293|548299|617733|534583|548305|295916|115953|116679|622248|548311|534589|381982|441608|637069|586251|519379|490470|305011|290771|636340|265638|476120|140882|116493|152682|113187|544183|105282|468224|267348|628263|291821|519385|105289|547507|586256|521143|457920|443844|167940|530761|493865|573521|227216|105310|144236|630148|202923|113205|141288|534937|283701|398505|320750|116589|634309|113811|521149|586261|460209|337974|586266|113223|629253|586271|598583|630143|583846|115083|586276|113847|521155|476862|426996|290764|232592|586426|460041|586431|231016|307146|283707|567589|113235|223344|404530|265626|115089|140275|630153|497519|220104|535225|113247|567595|402318|275604|186809|283713|332295|524539|168606|647152|586281|186825|105345|131317|495440|407690|338460|231984|476127|476134|121621|175953|115095|139960|167776|516062|613098|634312|640192|521167|500844|116884|146975|132430|267684|113259|657763|567601|113529|134968|548335|556297|567583|66597|477849|641392|431961|136634|534925|140282|398511|133102|172158|134569|578521|269010|495447|488545|457934|523567|604008|186633|588583|590588|634315|535219|133508|139918|118909|630158|476869|195767|174833|126480|634318|310303|154119|647569|500851|209880|150090|340716|497806|340722|661686|586436|581526|631843|302755|532855|610888|622258|322310|197703|431708|116595|422404|609343|638251|114039|137300|283743|176081|568211|105352|623918|399507|149565|266664|196671|643717|177673|594448|195775|586441|635776|573266|152340|658725|132920|116812|202944|523573|117958|641725|524527|506577|160147|441615|132577|308882|146636|523579|120487|404230|472116|633808|488636|209448|622263|397962|592588|637072|586446|112587|202930|635275|586451|553051|14726|175609|118038|544189|635278|635281|619778|380756|202229|113421|288041|463758|113541|630168|115101|523585|534595|295965|118108|647494|118188|117669|586456|220096|2043|113355|113547|441419|122872|120732|582596|634321|417991|153909|487635|398094|113553|613088|232664|431799|568651|617758|117160|603083|610893|578671|573271|232728|427024|634324|435356|114033|427017|398517|534601|577091|586291|460055|283827|608983|578681|161848|149523|575006|556327|603088|595768|354465|557947|113139|398100|586296|441622|604013|586301|203411|400101|171927|578301|441629|325412|232456|631867|541213|112214|563545|573276|617778|444229|319592|658164|633805|132997|252550|201855|596628|123089|573526|573531|399573|556381|340746|460202|573286|113883|400107|578896|321344|634327|633520|214584|633796|421933|115143|490862|573126|78420|563551|495454|116031|630766|450004|586701|586306|441636|112220|617783|571906|116487|399519|636349|334731|398412|624753|113775|399363|580321|137069|121866|597403|127880|149572|643189|586461|388696|528991|116037|583401|500865|1680|354459|113739|339096|649633|618723|567613|623938|573291|639925|210240|648946|402336|648949|477870|658482|525751)'))
AND ((`country_code`='UA') AND (`status_inherited`=1) AND (`sell_status` IN ('unavailable',
'waiting_for_supply', 'limited', 'available', 'out_of_stock')) AND (`status_inherited`
!= 0)) GROUP BY group_id WITHIN GROUP ORDER BY total_order ASC, is_popularity DESC,
is_group_primary DESC, goods_order ASC ORDER BY `total_order` ASC, `is_popularity`
DESC, `goods_order` ASC, `rank` DESC, `id` DESC LIMIT 4000 OPTION max_matches = 4000
--- request dump end ---
--- local index:category_4626923
Manticore 5.0.2 348514c86@220530 dev
Handling signal 11
-------------- backtrace begins here ---------------
Program compiled with Clang 13.0.1
Configured with flags: Configured with these definitions: -DDISTR_BUILD=buster -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmariadb.so.3 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore
Host OS is Linux x86_64
Stack bottom = 0x7f323421e430, thread stack size = 0x20000
Trying manual backtrace:
Something wrong with thread stack, manual backtrace may be incorrect (fp=0x7f323421d660)
Stack looks OK, attempting backtrace.
0x10dd670
Something wrong in frame pointers, manual backtrace failed (fp=10dc6c5)
Trying system backtrace:
begin of system symbols:
/usr/bin/searchd[0x599111]
/usr/bin/searchd[0x47bccf]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f32902c9730]
[0x7f3287fcec80]
Trying boost backtrace:
0# 0x0000000000599164 in /usr/bin/searchd
1# 0x000000000047BCCF in /usr/bin/searchd
2# 0x00007F32902C9730 in /lib/x86_64-linux-gnu/libpthread.so.0
3# 0x00007F3287FCEC80
-------------- backtrace ends here ---------------
Please, create a bug report in our bug tracker (https://github.com/manticoresoftware/manticore/issues)
and attach there:
a) searchd log, b) searchd binary, c) searchd symbols.
Look into the chapter 'Reporting bugs' in the manual
(https://manual.manticoresearch.com/Reporting_bugs)
Dump with GDB is not available
--- BT to source lines (depth 4): ---
------- FATAL: CRASH DUMP -------
[Thu Sep 8 15:02:21.517 2022] [93329]
--- crashed SphinxQL request dump ---
SELECT id, IF(IN(tags, 5), 1, 0) AS is_popularity,
IF(seller_id = 5 AND (sell_status
= 'available' OR sell_status = 'limited'), 1,
IF(sell_status = 'available' OR sell_status
= 'limited', 2, IF(seller_id = 5, 4, 5))) as rozetka_top_order,
IF(sell_status = 'waiting_for_supply',
9, 0)+IF(sell_status = 'limited', 2, 0)+IF(sell_status = 'available', 2, 0)+IF(sell_status
= 'out_of_stock', 10, 0)+IF(sell_status = 'unavailable', 11, 0) AS sell_status_order,
IF(state = 'new', 1, 3) as state_order, IF(price > 0, 1,85) as blank_price_order,
(rozetka_top_order * sell_status_order * state_order * blank_price_order) AS total_order
FROM `category_4626923` WHERE (MATCH('(@category_ids .4649052.) (@producer_id 648931|546523|630757|513612|586691|572786|460034|633508|113841|635272|519361|572791|116025|578196|548329|400089|604003|556315|573256|548323|648928|567577|133011|630760|573261|612423|548293|548299|617733|534583|548305|295916|115953|116679|622248|548311|534589|381982|441608|637069|586251|519379|490470|305011|290771|636340|265638|476120|140882|116493|152682|113187|544183|105282|468224|267348|628263|291821|519385|105289|547507|586256|521143|457920|443844|167940|530761|493865|573521|227216|105310|144236|630148|202923|113205|141288|534937|283701|398505|320750|116589|634309|113811|521149|586261|460209|337974|586266|113223|629253|586271|598583|630143|583846|115083|586276|113847|521155|476862|426996|290764|232592|586426|460041|586431|231016|307146|283707|567589|113235|223344|404530|265626|115089|140275|630153|497519|220104|535225|113247|567595|402318|275604|186809|283713|332295|524539|168606|647152|586281|186825|105345|131317|495440|407690|338460|231984|476127|476134|121621|175953|115095|139960|167776|516062|613098|634312|640192|521167|500844|116884|146975|132430|267684|113259|657763|567601|113529|134968|548335|556297|567583|66597|477849|641392|431961|136634|534925|140282|398511|133102|172158|134569|578521|269010|495447|488545|457934|523567|604008|186633|588583|590588|634315|535219|133508|139918|118909|630158|476869|195767|174833|126480|634318|310303|154119|647569|500851|209880|150090|340716|497806|340722|661686|586436|581526|631843|302755|532855|610888|622258|322310|197703|431708|116595|422404|609343|638251|114039|137300|283743|176081|568211|105352|623918|399507|149565|266664|196671|643717|177673|594448|195775|586441|635776|573266|152340|658725|132920|116812|202944|523573|117958|641725|524527|506577|160147|441615|132577|308882|146636|523579|120487|404230|472116|633808|488636|209448|622263|397962|592588|637072|586446|112587|202930|635275|586451|553051|14726|175609|118038|544189|635278|635281|619778|380756|202229|113421|288041|463758|113541|630168|115101|523585|534595|295965|118108|647494|118188|117669|586456|220096|2043|113355|113547|441419|122872|120732|582596|634321|417991|153909|487635|398094|113553|613088|232664|431799|568651|617758|117160|603083|610893|578671|573271|232728|427024|634324|435356|114033|427017|398517|534601|577091|586291|460055|283827|608983|578681|161848|149523|575006|556327|603088|595768|354465|557947|113139|398100|586296|441622|604013|586301|203411|400101|171927|578301|441629|325412|232456|631867|541213|112214|563545|573276|617778|444229|319592|658164|633805|132997|252550|201855|596628|123089|573526|573531|399573|556381|340746|460202|573286|113883|400107|578896|321344|634327|633520|214584|633796|421933|115143|490862|573126|78420|563551|495454|116031|630766|450004|586701|586306|441636|112220|617783|571906|116487|399519|636349|334731|398412|624753|113775|399363|580321|137069|121866|597403|127880|149572|643189|586461|388696|528991|116037|583401|500865|1680|354459|113739|339096|649633|618723|567613|623938|573291|639925|210240|648946|402336|648949|477870|658482|525751)'))
AND ((`country_code`='UA') AND (`status_inherited`=1) AND (`sell_status` IN ('unavailable',
'waiting_for_supply', 'limited', 'available', 'out_of_stock')) AND (`status_inherited`
!= 0)) GROUP BY group_id WITHIN GROUP ORDER BY total_order ASC, is_popularity DESC,
is_group_primary DESC, goods_order ASC ORDER BY `total_order` ASC, `is_popularity`
DESC, `goods_order` ASC, `rank` DESC, `id` DESC LIMIT 4000 OPTION max_matches = 4000
--- request dump end ---
--- local index:category_4626923
Manticore 5.0.2 348514c86@220530 dev
Handling signal 6
-------------- backtrace begins here ---------------
Program compiled with Clang 13.0.1
Configured with flags: Configured with these definitions: -DDISTR_BUILD=buster -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmariadb.so.3 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore
Host OS is Linux x86_64
Stack bottom = 0x7f32341fe420, thread stack size = 0x20000
Trying manual backtrace:
Something wrong with thread stack, manual backtrace may be incorrect (fp=0x7f32341fc5e0)
Stack looks OK, attempting backtrace.
0x10dd670
Something wrong in frame pointers, manual backtrace failed (fp=10dc6c5)
Trying system backtrace:
begin of system symbols:
/usr/bin/searchd[0x599111]
/usr/bin/searchd[0x47bccf]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f32902c9730]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x10b)[0x7f329012e7bb]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x7f3290119535]
/lib/x86_64-linux-gnu/libc.so.6(+0x79518)[0x7f3290170518]
/lib/x86_64-linux-gnu/libc.so.6(+0x7fc3a)[0x7f3290176c3a]
/lib/x86_64-linux-gnu/libc.so.6(+0x801b4)[0x7f32901771b4]
/usr/bin/searchd[0x46999e]
/usr/bin/searchd[0x525909]
[0x7f3254055d90]
Trying boost backtrace:
/builds/manticoresearch/dev/build/../src/sphinxutils.cpp:2874
/builds/manticoresearch/dev/build/../src/searchd.cpp:1119
??:0
??:0
[Thu Sep 8 15:02:22.353 2022] [93370] DEBUG: StartGlobalWorkpool
[Thu Sep 8 15:02:22.354 2022] [93370] starting daemon version '5.0.2 348514c86@220530 dev (columnar 1.15.4 2fef34e@220522) (secondary 1.15.4 2fef34e@220522)' ...
➤ Ilya Kuznetsov commented:
Unable to reproduce in latest master Manticore 5.0.3 58d6038fb@230114 dev (columnar 1.16.1 7fec1ab@230114) (secondary 1.16.1 7fec1ab@230114). There's no crash with or without pseudo_sharding. There's also no significant memory usage spike.
Feel free to reopen the issue is you manage to reproduce it in latest version.
