backstop-crawl

backstop-crawl copied to clipboard

Ignore certain urls by string

1

It would be nice to be able to ignore urls that contain certain strings in an array. Example: --ignore-url-containing = ["/blog,/tag,/news"]

qiigodev

Looks like crawler can't access the cookies in Cookies.json

RaviAtRACGP

Add option to pass configuration to simplecrawler directly

1

There are a lot of options in simplecrawler. Might be useful to allow passing options directly to the crawler for really custom setups. Like limiting crawl depth or number of...

minorOffense

Adding --max-depth and --strip-querystring

1

Resolves #13

wwhurley

- Re-dd simplecrawler maxDepth pass-through option, per #13 - Update README and usage - Add max-depth tests fixes https://github.com/fffunction/backstop-crawl/pull/33

aaronbauman

maxDepth

2

@urlsangel added maxDepth in 529cd77e39cd61efb6cb4b6cfd099a38bc28360b but I later removed it when I realised it is kinda hard to explain what it does and I don't think it's particularly helpful. Do...

danreeves

I need to use backstop-crawl to regenerate my test senarios from time to time. This is my backstop.template.json ``` { "viewports": [ { "label": "phone", "width": 320, "height": 480 },...

ghost

#### Description This PR fixes one or more vulnerable packages in the `npm` dependencies of this project. See the [Snyk test report](https://app.snyk.io/org/danreeves/test/github/123e6cc4-9946-4398-8be4-5153d3367723/master..snyk-fix-4wv42p) for more details. #### Snyk Project: [fffunction/backstop-crawl:package.json](https://app.snyk.io/org/danreeves/project/123e6cc4-9946-4398-8be4-5153d3367723) ####...

snyk-bot

``` /blog/ /blog/page/1/ /blog/page/2/ /blog/page/3/ /blog/post-1/ /blog/post-2/ /blog/post-3/ ``` Only `/blog/page/1/`,`/blog/page/2/`,`/blog/page/3/` will be kept

danreeves

Explain the problem and how this helps. Add some examples e.g. testing wordpress/plugin updates, css regressions, etc Check the backstop docs for a guide

danreeves