crawl icon indicating copy to clipboard operation
crawl copied to clipboard

Lightweight library for scalable crawlers in Go.

crawl

GoDoc Circle CI

Lightweight library for crawlers in Go.

HTML parsing and extracting is done thanks to goquery.

Usage

You can take a look at example crawler code.

License

                             Apache License
                       Version 2.0, January 2004
                    http://www.apache.org/licenses/