crawlie
crawlie copied to clipboard
nietaki
A simple Elixir library for writing decently-performing crawlers with minimum effort.
Besides other documentation changes, this commit ensures the generated HTML doc for HexDocs.pm will become the source of truth for this Elixir library and leverage on latest features of ExDoc.
Tested locally under Elixir 1.8.1 and OTP 21.2
The current mix file doesn't allow usage with the current version of GenStage (0.14.1), although reading through the changelog everything should work fine.
Currently each of the pages are considered on their own. This isn't a flexible enough model, when some page's data is important in the context of the parent page -...