fscrawler
fscrawler copied to clipboard
SLF4J: No SLF4J providers were found in version fscrawler-distribution-2.10-20230501.083424-195
[root@test bin]# ./fscrawler --config_dir /usr/local/src/fscrawler-distribution-2.10-20230501.083424-195/fscrawler-distribution-2.10-SNAPSHOT/test test --restart --loop 1
06:01:31,101 INFO [f.console] ,----------------------------------------------------------------------------------------------------.
| ,---,. .--.--. ,----.. ,--, 2.10-SNAPSHOT |
| ,' .' | / / '. / / \ ,--.'| |
| ,---.' || : /`. / | : : __ ,-. .---.| | : __ ,-. |
| | | .'; | |--` . | ;. /,' ,'/ /| /. ./|: : ' ,' ,'/ /| |
| : : : | : ;_ . ; /--` ' | |' | ,--.--. .-'-. ' || ' | ,---. ' | |' | |
| : | |-, \ \ `. ; | ; | | ,'/ \ /___/ \: |' | | / \ | | ,' |
| | : ;/| `----. \| : | ' : / .--. .-. | .-'.. ' ' .| | : / / |' : / |
| | | .' __ \ \ |. | '___ | | ' \__\/: . ./___/ \: '' : |__ . ' / || | ' |
| ' : ' / /`--' /' ; : .'|; : | ," .--.; |. \ ' .\ | | '.'|' ; /|; : | |
| | | | '--'. / ' | '/ :| , ; / / ,. | \ \ ' \ |; : ;' | / || , ; |
| | : \ `--'---' | : / ---' ; : .' \ \ \ |--" | , / | : | ---' |
| | | ,' \ \ .' | , .-./ \ \ | ---`-' \ \ / |
| `----' `---` `--`---' '---" `----' |
+----------------------------------------------------------------------------------------------------+
| You know, for Files! |
| Made from France with Love |
| Source: https://github.com/dadoonet/fscrawler/ |
| Documentation: https://fscrawler.readthedocs.io/ |
`----------------------------------------------------------------------------------------------------'
06:01:31,125 INFO [f.p.e.c.f.c.BootstrapChecks] Memory [Free/Total=Percent]: HEAP [12.6mb/417.6mb=3.02%], RAM [69.1mb/1.6gb=4.02%], Swap [1.6gb/1.9gb=80.35%].
06:01:31,579 INFO [f.p.e.c.f.FsCrawlerImpl] Starting FS crawler
SLF4J: No SLF4J providers were found.
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
SLF4J: Class path contains SLF4J bindings targeting slf4j-api versions 1.7.x or earlier.
SLF4J: Ignoring binding found at [jar:file:/usr/local/src/fscrawler-distribution-2.10-20230501.083424-195/fscrawler-distribution-2.10-SNAPSHOT/lib/log4j-slf4j-impl-2.20.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See https://www.slf4j.org/codes.html#ignoredBindings for an explanation.
06:01:32,447 INFO [f.p.e.c.f.c.ElasticsearchClient] Elasticsearch Client connected to a node running version 8.7.0
06:01:32,491 INFO [f.p.e.c.f.c.ElasticsearchClient] Elasticsearch Client connected to a node running version 8.7.0
06:01:32,686 INFO [f.p.e.c.f.FsParserAbstract] FS crawler started for [test] for [/usr/local/src/fscrawler-distribution-2.10-20230501.083424-195/fscrawler-distribution-2.10-SNAPSHOT/upload] every [15m]
06:01:32,848 INFO [f.p.e.c.f.t.TikaInstance] OCR is disabled.
06:01:35,148 INFO [f.p.e.c.f.FsParserAbstract] FS crawler is stopping after 1 run
06:01:35,289 INFO [f.p.e.c.f.FsCrawlerImpl] FS crawler [test] stopped
06:01:35,292 INFO [f.p.e.c.f.FsCrawlerImpl] FS crawler [test] stopped
[root@test bin]#
[root@test test]# cat _settings.yaml
\---
name: "test"
fs:
url: "/usr/local/src/fscrawler-distribution-2.10-20230501.083424-195/fscrawler-distribution-2.10-SNAPSHOT/upload"
update_rate: "15m"
excludes:
- "*/~*"
json_support: false
filename_as_id: false
add_filesize: true
remove_deleted: true
add_as_inner_object: false
store_source: false
index_content: true
attributes_support: false
raw_metadata: false
xml_support: false
index_folders: true
lang_detect: false
continue_on_error: false
ocr:
language: "eng"
enabled: true
pdf_strategy: "ocr_and_text"
follow_symlinks: false
elasticsearch:
nodes:
- url: "http://127.0.0.1:9200"
bulk_size: 100
flush_interval: "5s"
byte_size: "10mb"
ssl_verification: true
[root@test upload]# pwd
/usr/local/src/fscrawler-distribution-2.10-20230501.083424-195/fscrawler-distribution-2.10-SNAPSHOT/upload
[root@test upload]# ls
fscrawler.pdf
[root@test upload]# curl -XGET http://localhost:9200
{
"name" : "test.example.com",
"cluster_name" : "es_master_cluster",
"cluster_uuid" : "2wltwemmQnaTLXWYegOA2A",
"version" : {
"number" : "8.7.0",
"build_flavor" : "default",
"build_type" : "rpm",
"build_hash" : "09520b59b6bc1057340b55750186466ea715e30e",
"build_date" : "2023-03-27T16:31:09.816451435Z",
"build_snapshot" : false,
"lucene_version" : "9.5.0",
"minimum_wire_compatibility_version" : "7.17.0",
"minimum_index_compatibility_version" : "7.0.0"
},
"tagline" : "You Know, for Search"
}
Thanks for reporting.
I guess this is just a warn as everything seems to be working well, right?
But still, I need to understand what's happening with the packaging...
Getting the same message 5th Aug image: dadoonet/fscrawler:noocr