vessel
vessel copied to clipboard
Fast high-level web crawling Ruby framework
I want to inherit the settings of the parent class. In the current master version, the following code will run in **headless** mode. ```ruby class ApplicationSpider < Vessel::Cargo driver :ferrum,...
How can I make it not visit the same page multiple times? How can I make it so that it doesn't visit any pages outside of the `domain`?
The following code from README documentation does not work anymore: ```ruby class QuotesToScrapeCom < Vessel::Cargo # ... if next_page = at_xpath("//li[@class='next']/a[@href]") url = absolute_url(next_page.attribute(:href)) yield request(url: url, handler: :parse) end...