onionscan icon indicating copy to clipboard operation
onionscan copied to clipboard

Published 20 hours ago • verified publisher icon s-rah

For Larger Scans pipeline the Crawls and Analysis steps

Open s-rah opened this issue 8 years ago • 0 comments

Current the UX for larger scans is not that great as OnionScan has to complete a scan before processing any of the data - this means a lot of waiting around even when OnionScan has data straight away.

We should pipeline the flow so that each crawl result is sent through the analysis step and then reassembled at the end.

The UX for smaller scans / security scans likely still requires we complete the scan before any analysis - I'm not yet sure how to align these two - likely publish a "record-end" event once we finish the crawl.

s-rah avatar Oct 23 '16 04:10 s-rah