sist2 icon indicating copy to clipboard operation
sist2 copied to clipboard

Index Task hangs at the end?

Open RickConsole opened this issue 8 months ago • 0 comments

Device Information (please complete the following information):

  • OS: Ubuntu 22.04.4 LTS
  • Deployment: Docker
  • SIST2 Version: Unknown since container is listed as: sist2app/sist2:x64-linux. Let me know how I can enum the version, but the container was created two months ago.
  • Elasticsearch Version (if relevant) : 7.17.9``

Command with arguments

Describe the bug After running a scan on a directory, then running the index, the index hangs on what im assuming is the last file to be indexed. I've waited way longer than normal for it to complete and yet it still hangs.

Steps To Reproduce Please be specific!

  1. Queue up a scan/index task
  2. Click on the "tasks" page
  3. The scan will complete without issue, but the index hangs on the final file.

Expected behavior The index job will complete as it has done with all other directories i have scanned.

Actual Behavior The index job hangs on what im assuming is the final file, so im not sure what exactly the issue is.

Screenshots

Image

Additional context I have been queuing up scans that are hundreds of gigabytes in size, and none have failed like this yet. Logs also dont mention anything about it either:

2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 70 documents (3kB) <200>
2025-04-17 18:42:04 [INFO tpool.c] Worker threads finished
2025-04-17 18:42:04 [INFO tpool.c] Destroying thread pool
2025-04-17 18:42:04 [DEBUG database.c] Closing database /dev/shm/sist2-ipc-128.sqlite (0x560fb3d23148)
2025-04-17 18:42:04 [DEBUG elastic.c] Indexed 50 documents (2kB) <200>
2025-04-17 18:42:04 [DEBUG elastic.c] Destroying indexer
2025-04-17 18:42:04 [DEBUG database.c] Closing database /dev/shm/sist2-ipc-128.sqlite (0x7f4780001128)
2025-04-17 18:42:04 [DEBUG tpool.c] Child process terminated with status code 0
2025-04-17 18:42:04 [INFO elastic.c] Refresh index <200>
2025-04-17 18:42:05 [INFO elastic.c] Merge index <200>
2025-04-17 18:42:05 [INFO elastic.c] Set refresh interval <200>

RickConsole avatar Apr 17 '25 19:04 RickConsole