Peter Svanberg

Results 6 comments of Peter Svanberg

Yes, that would be good. But the colour difference is hard to see in the time stamps when you click, so some extra marking is needed. And also (from [Slack](https://iipc.slack.com/archives/C2NR32PNF/p1686098456533469?thread_ts=1684937142.719479&cid=C2NR32PNF):)...

Everything after a # in a URL is the fragment part, and it is never sent to the server, but is handled by the web browser. (Normally to scroll to...

> Hi, thanks @obrienben! This is in scope for the IIPC-funded pywb work, which is due to be delivered end of March, so we will be working on this in...

@notcancername Could you give examples of other used or suggested values, and what they would mean? @wumpus I don't see how RFC 9309 solves this problem, what did you mean?

You can also use value "obey" and in org.archive.crawler.prefetch.PreconditionEnforcer specify calculateRobotsOnly=true. Then robots.txt is NOT obeyed, but exlcuded URIs are annotated in the crawl.log. for use in presentation and usage...

Nice! When you export parts of WARC files it is maybe not necessary to replace revisit records "in place" to response records. You could instead extract all visit record referenced...