--ignore_fragments is not supported (but documented)

[agross]

$ bundle exec rawler --ignore_fragments http://google.com
Error: unknown argument '--ignore_fragments'.
Try --help for help.

$ bundle exec rawler --ignore_fragments http://google.com
Error: unknown argument '--ignore_fragments'.
Try --help for help.

--help doesn't print the option, despite it being documented on GitHub.

$ bundle exec rawler --help
Rawler is a command line utility for parsing links on a website

Usage:
      rawler http://example.com [options]

where [options] are:
  --username, -u <s>:   HTTP Basic Username
  --password, -p <s>:   HTTP Basic Password
      --wait, -w <f>:   Seconds to wait between requests, may be fractional
                        e.g. '1.5' (default: 3.0)
           --log, -l:   Log results to file rawler_log.txt
   --logfile, -o <s>:   Specify logfile, implies --log (default:
                        rawler_log.txt)
           --css, -c:   Check CSS links
      --skip, -s <s>:   Skip URLs that match a pattern
     --iskip, -i <s>:   Skip URLs that match a case insensitive pattern
   --include, -n <s>:   Only include URLS that match a pattern
  --iinclude, -d <s>:   Only include URLS that match a case insensitive
                        pattern. Equivalent to '--include
                        ^http://mysite.com/*'.
         --local, -a:   Restrict to the given URL and below
       --version, -v:   Print version and exit
          --help, -h:   Show this message

[agross]

$ gem list --local rawler

*** LOCAL GEMS ***

rawler (0.1.8)

[matkoniecz]

@oscardelben So this gem is dead, right?

[agross]

@matkoniecz I think it is. In the meantime I switched to this one which also has more features: https://www.npmjs.com/package/broken-link-checker

[matkoniecz]

@agross Thanks for a recommendation!

[oscardelben]

Hi,

It's not actively maintained. Sorry about that.