spidey icon indicating copy to clipboard operation
spidey copied to clipboard

Published 20 hours ago • verified publisher icon joeyAghion

JavaScript support?

Open mgiagante opened this issue 8 years ago • 2 comments

Hello all, I just took a look at spidey and it sounds very handy to me. Still, since it relies on Mechanize, as far as I know, it doesn't support JavaScript execution. Are there any plans on supporting other drivers? If so, please count with my fork.

mgiagante avatar Jul 22 '16 01:07 mgiagante

I'm not actively working on spidey at the moment, but future work could certainly take it in this direction. Specifically, to:

  1. refactor the internals to support multiple crawling "providers," and
  2. implement a javascript-enabled provider

Pull requests welcome!

joeyAghion avatar Aug 17 '16 16:08 joeyAghion

That's good to know. I will do my best to send one. For now, just to leave a short insight, the only candidate project I know of that standardized a protocol for all of its drivers is Capybara. One of these drivers is Poltergeist (which uses PhantomJs) and it's javascript-enabled.

mgiagante avatar Aug 18 '16 01:08 mgiagante