openwayback icon indicating copy to clipboard operation
openwayback copied to clipboard

Improved Canonicalization

Open PsypherPunk opened this issue 10 years ago • 1 comments

The current status of Wayback's canonicalization is documented here.

This should be amended to be similar to that of Heritrix: i.e. a configurable series of steps, broadly outlined here, ideally sharing the same codebase to do so.

PsypherPunk avatar May 12 '14 15:05 PsypherPunk

There is one element of canonicalization where Heritrix and Wayback will need to differ and that is that Wayback will need to handle changing canonicalization rules over time!

kris-sigur avatar May 12 '14 15:05 kris-sigur