vessel icon indicating copy to clipboard operation
vessel copied to clipboard

Fast high-level web crawling Ruby framework

Results 3 vessel issues
Sort by recently updated
recently updated
newest added

I want to inherit the settings of the parent class. In the current master version, the following code will run in **headless** mode. ```ruby class ApplicationSpider < Vessel::Cargo driver :ferrum,...

How can I make it not visit the same page multiple times? How can I make it so that it doesn't visit any pages outside of the `domain`?

The following code from README documentation does not work anymore: ```ruby class QuotesToScrapeCom < Vessel::Cargo # ... if next_page = at_xpath("//li[@class='next']/a[@href]") url = absolute_url(next_page.attribute(:href)) yield request(url: url, handler: :parse) end...