Domain scanning takes very long

[sakd3rmo]

Is there an existing issue for this?

• [X] I have searched the existing issues

Current Behavior

I scanned one domain with the Full scan model and it wasn't finished for a week, so I stopped the scan (canceled it). Why does scanning just one domain take that long when it's a new domain, not one that's been around for several years?

Expected Behavior

Domain scanning doesn't take long

Steps To Reproduce

1. Add target
2. Input domain
3. Initial Scan, i choose full scan
4. Process scanning

Environment

- reNgine: 2.0.2
- OS: Ubuntu 22.04.3 LTS Jammy 
- Python: 3.10.12
- Docker Engine: 24.0.7, build afdd53b
- Docker Compose: v2.21.0
- Browser: Mozila Firefox 120.0.1

Anything else?

[github-actions[bot]]

👋 Hi @bausastra, Issues is only for reporting a bug/feature request. Please read documentation before raising an issue https://rengine.wiki For very limited support, questions, and discussions, please join reNgine Discord channel: https://discord.gg/azv6fzhNCE Please include all the requested and relevant information when opening a bug report. Improper reports will be closed without any response.

[psyray]

We need to have detailed logs See activation here #994 In your case you need also to add a DEBUG export var in the celery-entrypoint.sh and restart container

Run make logs | grep celery and launch scan again to see if there are errors (stacktrace, crash...)

[sakd3rmo]

Hai @psyray Scanning Domain always stuck in progress 50%

[AnonymousWP]

Hai @psyray Scanning Domain always stuck in progress 50%

So, like we suggested: show some logs then.

[sakd3rmo]

Hai @AnonymousWP When i command "make logs | grep celery" this is results

[AnonymousWP]

That looks good. Apart from running that command, did you also follow the steps in https://github.com/yogeshojha/rengine/pull/994?

[psyray]

@bausastra News ?

[psyray]

@bausastra Give us some feedback please. Does this problem reproduces with all your target, or only one ? Without feedback next week we will close this issue