fscrawler
fscrawler copied to clipboard
dadoonet
Elasticsearch File System Crawler (FS Crawler)
**Describe the bug** Running docker-compose, set the logging directory in the docker-compose file. fscrawler.log gets populated and rotated, but documents.log in that same folder does not. **Job Settings** $ cat...
This is coming from this discussion: https://stackoverflow.com/a/76313247/1432281 We should support the indexation of specific metadata per file, by checking if a file named `foo.pdf.json` for example exists in a side...
Normally, as FSCrawler is running, it should be able to serve also files over http. That'd ease demo making as we won't have to use a Python web server anymore....
**Describe the bug** Unit tests, e.g. JsonUtilTest.java, are not executed when running `mvn test` and only when `mvn verify` **Expected behavior** Unit tests should run independent of integration tests **Versions:**...
The documentation states that if the file size is bigger than ignore_above, It will not be sent to Tike for content parsing. But in fact, It ignores it completely and...
**Describe the bug** We are indexing a .doc having page numbers in the headers. After indexing, we see a number at the beginning of the indexed document, which we presume...
**Describe the bug** Fails to send index (also errors about threads). **Job Settings** ```yml --- name: "idx" fs: url: "/tmp/es" indexed_chars: 100% lang_detect: true continue_on_error: true update_rate: "1m" ocr: pdf_strategy:...
**Describe the bug** I am following the standard setup guide, but fail to get fscrawler started. I call `docker-compose up -d` from "masters". Elastic and Kibana fire up. I have...
Let see if we can switch to GraalVM and produce native binaries instead.