manticoresearch icon indicating copy to clipboard operation
manticoresearch copied to clipboard

WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory

Open cappadaan opened this issue 3 years ago • 19 comments

Describe the bug

After upgrading from 4.2 to 5.0.2 the indexer shows me this warning WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory

But the indexer works as expected.

Expected behavior Should give me no warning or at least a human readable warning

cappadaan avatar Jun 04 '22 09:06 cappadaan

you should install columnar package to get rid of this warning

tomatolog avatar Jun 04 '22 14:06 tomatolog

After upgrading from 4.2 to 5.0.2 the indexer shows me this warning

  1. What's the operating system?
  2. Did you use the MCL (Manticore Columnar Library) before?

sanikolaev avatar Jun 06 '22 06:06 sanikolaev

  • What's the operating system? CentOS 7 Linux 3.10.0 x86_64 GNU/Linux

  • Did you use the MCL (Manticore Columnar Library) before? No

cappadaan avatar Jun 06 '22 07:06 cappadaan

@cappadaan 2 more questions:

  1. Did you build it yourself or it's an official package?
  2. Can you run indexer with no params and provide the output?

sanikolaev avatar Jun 07 '22 09:06 sanikolaev

  1. Installed via: yum install manticore

[user@sphinx user]$ indexer Manticore 5.0.2 348514c@220530 dev Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

Built on Linux x86_64 by Clang 7.0.1 compiler.

Configured with these definitions: -DDISTR_BUILD=rhel7 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore

Usage: indexer [OPTIONS] [indexname1 [indexname2 [...]]]

Options are: -h, --help display this help message -v, --version display version information --config read configuration from specified file (default is manticore.conf) --all reindex all configured indexes --quiet be quiet, only print errors --noprogress do not display progress (automatically on if output is not to a tty) --rotate send SIGHUP to searchd when indexing is over to rotate updated indexes automatically --sighup-each send SIGHUP to searchd after each index (used with --rotate only) --buildstops <output.txt> <N> build top N stopwords and write them to given file --buildfreqs store words frequencies to output.txt (used with --buildstops only) --merge merge 'src-index' into 'dst-index' 'dst-index' will receive merge result 'src-index' will not be modified --merge-dst-range filter 'dst-index' on merge, keep only those documents where 'attr' is between 'min' and 'max' (inclusive) --drop-src clears src index after merge --dump-rows <FILE> dump indexed rows into FILE --print-queries print SQL queries (for debugging) --print-rt print indexed rows as SQL insert commands and field mapping info for populating an RT index --keep-attrs retain attributes from the old index

Examples: indexer --quiet myidx1 reindex 'myidx1' defined in 'manticore.conf' indexer --all reindex all indexes defined in 'manticore.conf'

cappadaan avatar Jun 07 '22 10:06 cappadaan

Over default there are 3 env variables which affects path of searching for columnar library.

  • LIB_MANTICORE_COLUMNAR might be set to full path to the library (i.e., if it set to /usr/bin/lib_manticore_columnar.so, then manticore will look the library exactly at this path and nowhere else). If it is NOT set, then

  • MANTICORE_MODULES might be set to the folder where columnar (and other modules) lives (i.e. if it set to /usr/bin, then manticore will look for module named lib_manticore_columnar.so exactly at this path, and nowhere else; as far as also other modules like galera and others not-specified explicitly via env). If it is NOT set, then finally

*FULL_SHARE_DIR might be set to the generic share folder. Modules are located in $FULL_SHARE_DIR/modules, so columnar will be searched at $FULL_SHARE_DIR/modules/lib_manticore_columnar.so. But it is definitely not your case, as there is no 'modules' word in your path.

So, I suspect, first or second env can be active and affect the search. Or, if not, issue need further investigation.

Anyway, without any investigations, you can explicitly set any of mentioned variables to the known where lib is placed, and it should work.

klirichek avatar Jun 07 '22 10:06 klirichek

Columnar is not installed, I dont even know what it is. I would then expect something like this:

WARNING: Columnar not installed on {path}, skipping

cappadaan avatar Jun 09 '22 08:06 cappadaan

I can't reproduce the issue in a clean Centos 7:

[root@d06c28705b4c /]# cat /etc/*release*|head -1
CentOS Linux release 7.8.2003 (Core)

[root@d06c28705b4c /]# sudo yum install https://repo.manticoresearch.com/manticore-repo.noarch.rpm
Loaded plugins: fastestmirror, ovl
manticore-repo.noarch.rpm                                                                                                                            | 6.7 kB  00:00:00
Examining /var/tmp/yum-root-2jZiS5/manticore-repo.noarch.rpm: manticore-repo-0.0.1-1.noarch
Marking /var/tmp/yum-root-2jZiS5/manticore-repo.noarch.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package manticore-repo.noarch 0:0.0.1-1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

============================================================================================================================================================================
 Package                                    Arch                               Version                             Repository                                          Size
============================================================================================================================================================================
Installing:
 manticore-repo                             noarch                             0.0.1-1                             /manticore-repo.noarch                             463

Transaction Summary
============================================================================================================================================================================
Install  1 Package

Total size: 463
Installed size: 463
Is this ok [y/d/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : manticore-repo-0.0.1-1.noarch                                                                                                                            1/1
  Verifying  : manticore-repo-0.0.1-1.noarch                                                                                                                            1/1

Installed:
  manticore-repo.noarch 0:0.0.1-1

Complete!

[root@d06c28705b4c /]# sudo yum install manticore
...
  Installing : manticore-devel-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                                 5/7
  Installing : manticore-icudata-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                               6/7
  Installing : manticore-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                       7/7
  Verifying  : manticore-icudata-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                               1/7
  Verifying  : manticore-tools-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                 2/7
  Verifying  : manticore-common-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                                3/7
  Verifying  : manticore-server-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                4/7
  Verifying  : manticore-devel-5.0.2_220530.348514c-1.el7.centos.noarch                                                                                                 5/7
  Verifying  : manticore-server-core-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                           6/7
  Verifying  : manticore-5.0.2_220530.348514c-1.el7.centos.x86_64                                                                                                       7/7

Installed:
  manticore.x86_64 0:5.0.2_220530.348514c-1.el7.centos

Dependency Installed:
  manticore-common.noarch 0:5.0.2_220530.348514c-1.el7.centos                             manticore-devel.noarch 0:5.0.2_220530.348514c-1.el7.centos
  manticore-icudata.noarch 0:5.0.2_220530.348514c-1.el7.centos                            manticore-server.x86_64 0:5.0.2_220530.348514c-1.el7.centos
  manticore-server-core.x86_64 0:5.0.2_220530.348514c-1.el7.centos                        manticore-tools.x86_64 0:5.0.2_220530.348514c-1.el7.centos

Complete!

[root@d06c28705b4c /]# indexer -v
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

[root@d06c28705b4c /]# indexer
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

Built on Linux x86_64 by Clang 7.0.1 compiler.

Configured with these definitions: -DDISTR_BUILD=rhel7 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore

Usage: indexer [OPTIONS] [indexname1 [indexname2 [...]]]

After upgrading from 4.2 to 5.0.2 the indexer shows me this warning

At what moment did you see the warning? According to your indexer's output there's none.

sanikolaev avatar Jun 10 '22 13:06 sanikolaev

There is no such warning by default. Only if columnar persist on the path, but not available (i.e. incompatible, or something else). Anyway, reporting error about /usr/bin/lib_manticore_columnar.so definitely means, that you've customized MANTICORE_MODULES or LIB_MANTICORE_COLUMNAR env on your system. Default path would be /usr/share/manticore/modules/lib_manticore_columnar.so, and never /usr/bin.

klirichek avatar Jun 10 '22 14:06 klirichek

At what moment did you see the warning? According to your indexer's output there's none.

When I run the indexer, the warning is there.

There is no such warning by default. Only if columnar persist on the path, but not available (i.e. incompatible, or something else). Anyway, reporting error about /usr/bin/lib_manticore_columnar.so definitely means, that you've customized MANTICORE_MODULES or LIB_MANTICORE_COLUMNAR env on your system. Default path would be /usr/share/manticore/modules/lib_manticore_columnar.so, and never /usr/bin.

I never set any of these env on the system, strange

cappadaan avatar Jun 10 '22 14:06 cappadaan

@cappadaan we've discussed it and have a clue why it may be happening, but are not aure.

Can you please provide:

  • exact command you use to run indexer and the full output, which demonstrates the warning
  • ls -la /usr/bin/lib_manticore_columnar.so
  • find /usr/share/manticore/modules/|xargs ls -la
  • yum list installed|grep manticore

?

sanikolaev avatar Jun 13 '22 10:06 sanikolaev

  • exact command you use to run indexer and the full output, which demonstrates the warning

indexer --rotate --all -c /path_to_my_config.conf

Manticore 5.0.2 348514c@220530 dev Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file '/path_to_my_config.conf'... WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory WARNING: skipping non-plain index 'template_index'... indexing index 'INDEX_NAME'...

  • ls -la /usr/bin/lib_manticore_columnar.so

ls: cannot access /usr/bin/lib_manticore_columnar.so: No such file or directory

  • find /usr/share/manticore/modules/|xargs ls -la

-rwxr-xr-x 1 root root 2025408 May 30 10:04 /usr/share/manticore/modules/libgalera_manticore.so

/usr/share/manticore/modules/: total 1988 drwxr-xr-x 2 root root 4096 Jun 4 11:06 . drwxr-xr-x 6 root root 4096 Jun 4 11:06 .. -rwxr-xr-x 1 root root 2025408 May 30 10:04 libgalera_manticore.so

  • yum list installed|grep manticore

Failed to set locale, defaulting to C Manticore-repo.noarch 0.0.1-1 @/manticore-repo.noarch manticore.x86_64 5.0.2_220530.348514c-1.el7.centos @manticore
manticore-common.noarch 5.0.2_220530.348514c-1.el7.centos @manticore
manticore-devel.noarch 5.0.2_220530.348514c-1.el7.centos @manticore
manticore-icudata.noarch 5.0.2_220530.348514c-1.el7.centos @manticore
manticore-server.x86_64 5.0.2_220530.348514c-1.el7.centos @manticore
manticore-server-core.x86_64 5.0.2_220530.348514c-1.el7.centos @manticore
manticore-tools.x86_64 5.0.2_220530.348514c-1.el7.centos @manticore

cappadaan avatar Jun 13 '22 11:06 cappadaan

Still can't reproduce it:

[root@fac5a64ddb2c /]# indexer -c csv.conf --all
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'csv.conf'...
WARNING: skipping non-plain index 'tpl'...
indexing index 'idx'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 3 bytes
total 0.152 sec, 19 bytes/sec, 6.57 docs/sec
total 3 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

[root@fac5a64ddb2c /]# ls -la /usr/bin/lib_manticore_columnar.so
ls: cannot access /usr/bin/lib_manticore_columnar.so: No such file or directory

[root@fac5a64ddb2c /]# find /usr/share/manticore/modules/|xargs ls -la
-rwxr-xr-x 1 root root 2025408 May 30 08:04 /usr/share/manticore/modules/libgalera_manticore.so

/usr/share/manticore/modules/:
total 1988
drwxr-xr-x 2 root root    4096 Jun 13 14:42 .
drwxr-xr-x 6 root root    4096 May 22 04:12 ..
-rwxr-xr-x 1 root root 2025408 May 30 08:04 libgalera_manticore.so

[root@fac5a64ddb2c /]# yum list installed|grep manticore
manticore.x86_64                   5.0.2_220530.348514c-1.el7.centos @manticore
manticore-common.noarch            5.0.2_220530.348514c-1.el7.centos @manticore
manticore-devel.noarch             5.0.2_220530.348514c-1.el7.centos @manticore
manticore-icudata.noarch           5.0.2_220530.348514c-1.el7.centos @manticore
manticore-repo.noarch              0.0.1-1                           @/manticore-repo.noarch
manticore-server.x86_64            5.0.2_220530.348514c-1.el7.centos @manticore
manticore-server-core.x86_64       5.0.2_220530.348514c-1.el7.centos @manticore
manticore-tools.x86_64             5.0.2_220530.348514c-1.el7.centos @manticore

[root@fac5a64ddb2c /]# indexer
Manticore 5.0.2 348514c@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

Built on Linux x86_64 by Clang 7.0.1 compiler.

Configured with these definitions: -DDISTR_BUILD=rhel7 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.18 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore/data -DFULL_SHARE_DIR=/usr/share/manticore

Usage: indexer [OPTIONS] [indexname1 [indexname2 [...]]]
...

I.e. everything looks the same, but I don't get the warning. Can you share your configuration file?

sanikolaev avatar Jun 13 '22 14:06 sanikolaev

I uploaded the conf to your FTP

cappadaan avatar Jun 13 '22 14:06 cappadaan

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Feel free to re-open the issue in case it becomes actual.

stale[bot] avatar Jul 31 '22 07:07 stale[bot]

Getting the exact same warning with a ~~fresh~~ install on a Debian machine.

Taking a peek at the code, it seems obvious why it's happening:

  1. one of the first things the indexer tries to do is load the columnar plugin
  2. the init call will try to dlopen the library
  3. if the file doesn't exist, it'll set the error and just continue on
  4. the sError variable name is re-used for collation errors but a successful call doesn't clear the error
  5. so basically, if the columnar plugin fails to load, and collation_server was correctly set, it'll print the warning

Haven't bothered trying to verify this (the debug symbols in the Debian repo are only provided for 4.2.0 (manticore-dbgsym_4.2.0-211223-15e927b28_amd64.deb) not 5.0.2), but it seems plausible.

Fortunately, it doesn't actually prevent anything from working :)

animetosho avatar Sep 09 '22 03:09 animetosho

@animetosho

How do you reproduce it? Here's what I get in a clean Debian Bullseye:

root@1daeaedfd24d:/# sudo apt install manticore
...
root@1daeaedfd24d:/# indexer -v
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

root@1daeaedfd24d:/# searchd -v
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)
root@1daeaedfd24d:/# sudo apt install manticore-columnar-lib
...
root@1daeaedfd24d:/# searchd -v
Manticore 5.0.2 348514c86@220530 dev (columnar 1.15.4 2fef34e@220522) (secondary 1.15.4 2fef34e@220522)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

root@1daeaedfd24d:/# indexer -v
Manticore 5.0.2 348514c86@220530 dev (columnar 1.15.4 2fef34e@220522) (secondary 1.15.4 2fef34e@220522)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

All the libraries are stored not in /usr/bin/ as the issue's title says, but in:

root@1daeaedfd24d:/# ls -la /usr/share/manticore/modules/lib*
-rw-r--r-- 1 root root 4420704 May 22 04:29 /usr/share/manticore/modules/lib_manticore_columnar.so
-rw-r--r-- 1 root root 1185360 May 22 04:29 /usr/share/manticore/modules/lib_manticore_secondary.so
-rwxr-xr-x 1 root root 2019112 May 30 08:03 /usr/share/manticore/modules/libgalera_manticore.so

the binaries should be looking for the libraries there, not in /usr/bin

You can easily install 5.0.2 debug symbols in Debian like this:

apt install manticore-server-core-dbgsym manticore-tools-dbgsym

or manually by finding the debug symbol packages on https://repo.manticoresearch.com/

There's also find-dbgsym-packages from package debian-goodies which helps finding debug symbol packages. Manticore supports it:

root@1daeaedfd24d:/# find-dbgsym-packages /usr/bin/searchd
W: No dbg package for source 'zlib'
W: Cannot find debug package for /lib/x86_64-linux-gnu/libz.so.1 (70a770d9b600208bb51e5f4d6a3bf4e344d13478)
W: No dbg package for source 'openssl'
W: Cannot find debug package for /usr/lib/x86_64-linux-gnu/libssl.so.1.1 (847f26496373ebc96c8b34eae3e12390d6c128ca)
W: No dbg package for source 'openssl'
W: Cannot find debug package for /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1 (08aa8c462037f6809d07ab8b9baaeb9100ece88e)
lib32stdc++6-10-dbg libc6-dbg libstdc++6-10-dbg libx32stdc++6-10-dbg manticore-server-core-dbgsym

(see the last line)

root@1daeaedfd24d:/# find-dbgsym-packages /usr/bin/indexer
W: No dbg package for source 'zlib'
W: Cannot find debug package for /lib/x86_64-linux-gnu/libz.so.1 (70a770d9b600208bb51e5f4d6a3bf4e344d13478)
lib32stdc++6-10-dbg libc6-dbg libstdc++6-10-dbg libx32stdc++6-10-dbg manticore-tools-dbgsym

(see the last line)

sanikolaev avatar Sep 09 '22 03:09 sanikolaev

Sorry, this isn't exactly a clean install - my setup script had put my config on there; apologies for the incorrect assertion.

Thanks for the pointer on debug symbols - didn't know that the name has changed.
Looking at it in GDB, it's as I expected

(gdb) b sphWarning_impl
Breakpoint 1 at 0x4b8450: file ../src/sphinxutils.cpp, line 1641.
(gdb) r idx_main_combined
Starting program: /usr/bin/indexer idx_main_combined
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file '/etc/manticoresearch/manticore.conf'...

Breakpoint 1, sphWarning_impl (sFmt=0xced554 "%s") at ../src/sphinxutils.cpp:1641
1641    ../src/sphinxutils.cpp: No such file or directory.
(gdb) bt
#0  sphWarning_impl (sFmt=0xced554 "%s") at ../src/sphinxutils.cpp:1641
#1  0x00000000004153e3 in main (argc=<optimized out>, argv=0x7fffffffe500) at ../src/indexer.cpp:1988

As with the original poster, I don't have the columnar plugin installed.

I'm guessing you can reproduce it with the following conditions:

  1. not have the columnar plugin installed
  2. have the collation_server option set under searchd { ... } config to a valid value (I have collation_server = utf8_general_ci)
  3. run indexer on one or more index

animetosho avatar Sep 09 '22 04:09 animetosho

Thanks @animetosho

MRE

root@1daeaedfd24d:/# cat min.conf
searchd {
    listen = 9315:mysql41
    log = searchd.log
    pid_file = searchd.pid
    binlog_path =
    collation_server = utf8_general_ci
}

source src {
    type = csvpipe
    csvpipe_command = echo "1,abc"
    csvpipe_field = f
}

index idx {
    type = plain
    source = src
    path = idx
    stored_fields = f
}

root@1daeaedfd24d:/# indexer -c min.conf --all
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'min.conf'...
WARNING: dlopen() failed: /usr/bin/lib_manticore_columnar.so: cannot open shared object file: No such file or directory
indexing index 'idx'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 3 bytes
total 0.124 sec, 24 bytes/sec, 8.03 docs/sec
total 3 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

Same w/o collation_server:

root@1daeaedfd24d:/# indexer -c min.conf --all
Manticore 5.0.2 348514c86@220530 dev
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'min.conf'...
indexing index 'idx'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 3 bytes
total 0.256 sec, 11 bytes/sec, 3.89 docs/sec
total 3 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

We can now look into this.

sanikolaev avatar Sep 09 '22 04:09 sanikolaev

➤ Ilya Kuznetsov commented:

Fixed in 426c47c1

githubmanticore avatar Jan 19 '23 12:01 githubmanticore