phantomCrawl
phantomCrawl copied to clipboard
This project definitively deserve better documentation
On pages using synchronous AJAX request, the page ready is never fired. This need to be investigated.
When loading a page with some ajax request done from JS, these request are crawled as static resources. It should be possible to blacklist them based on url patterns.
When a plugin inject a method in the page, this method could possibly be asynchronous.