sitediff

sitediff copied to clipboard

Sitediff init not creating Paths.txt

5

Hello, I just installed Sitediff on a fresh Ubuntu VM with Ruby 2.6.6. When i run the Sitediff init command, tried with a few webpages, it just creates the sitediff.yaml,...

Saibot97

sitediff version throws error

1

Running sitediff version with sitediff 1.1.1 throws an error: ➜ docker run -it evolvingweb/sitediff sitediff version Traceback (most recent call last): 7: from /usr/local/bundle/bin/sitediff:23:in `' 6: from /usr/local/bundle/bin/sitediff:23:in `load' 5:...

mmunz

Feature request - crawl sitemap.xml

4

We are finding sitediff works quite well, however it may not find all the URLS on a site by links from the home page. We would like (optionally) to be...

Mark-Hetherington

feature backlog suggestion: API diffs

1

Not a burning need, more of an interesting idea: I wonder if there's a use case for API diffs This was inspired by this article: https://radar.io/blog/open-source-api-diff-library

dergachev

Perform validation on YAML files

1

Currently, you can add any random key to most contexts in the file without an error or warning. Maybe something like this would help: https://blog.picnic.nl/how-to-use-yaml-schema-to-validate-your-yaml-files-c82c049c2097

cleaver

sitediff fails with "Not a directory @ apply2files" if crawl only produces one page

6

Sitediff fails to compare 2 single-paged URLs/sites: the before/after entries in the snapshots directory are files, not directories containing other entries, so this should also be taken into account Error...

fgerards

If a website's URL is www.example.com, and we have the URL example.com in the sitediff.yaml file, SiteDiff will ignore all URLs with www. Therefore, no pages will be crawled. SiteDiff...

mahieddineak

Crawler throws error when URL has leading/trailing whitespace

1

Given that browsers ignore the whitespace and links work, the crawler should be able to trim it before the request.

gardon

Right now it seems impossible to define independent `curl_opts` (such as basic auth credentials) for `before` and `after`. Both sections will be overridden by the global curl_opts, even if the...

SomeBdyElse

Paths with trailing slashes always have the trailing slash removed

1

We are working with a site that has a number of index pages, by category. It uses URLS of the form /content//, and uses the trailing slash to differentiate between...

Mark-Hetherington