crawly icon indicating copy to clipboard operation
crawly copied to clipboard

Use a more reliable website to crawl in tutorial

Open james-s-w-clark opened this issue 2 years ago • 0 comments

The tutorial uses the homebase site. I think the site layout has changed - for example, there's no body returned for this code in the tutorial:

iex(3)> response = Crawly.fetch("https://www.homebase.co.uk/our-range/tools")
%HTTPoison.Response{
  body: "",

A more reliable alternative might be some options from

  • https://www.scrapethissite.com/pages/
  • https://webscraper.io/test-sites Thoughts?

james-s-w-clark avatar Jun 25 '22 09:06 james-s-w-clark