yoshimo
yoshimo
It seems to work fine most of the time. Github plays fine with the etags i send, but gitlab sends a 200 code and the same etag that i gave...
> I'll be honest, this is not a problem I've noticed personally, and wonder if this change adds unnessacery complexity (read: making it harder to maintain the change in future)...
> I'd probably put the additional output behind a debug flag (for testing it is nice) and assure that the Etag is really set (not empty) before storing it. I...
Urlhaus breaks parsing because of ``` content-security-policy: default-src 'self' https://fonts.gstatic.com:443 data:; style-src 'self' 'unsafe-inline' https://www.gs tatic.com:443 https://fonts.googleapis.com:443; script-src 'self' 'unsafe-inline' 'unsafe-eval' https://www.gstatic.com:443 https://www.google.com/recaptcha/ https://www.googletagmanager.com:443; frame-src https://www.google.com/recaptcha/; img-src 'self' data: https://syndication.twitter.com:443;...
So i have a new thesis what is going on: Escaping of quotes. ```curl -sI --header "If-None-Match: W/\"53df85ca8b85e81646bbf90fd8114877\"" https://gitlab.com/nobodysu/spyware-hosts/raw/master/lists/qualcomm-mild.txt``` gives me a 304 not modified on the shell ``` httpCode=$(curl...
> Use single quotes around the complete header. Single Quotes don't behave well with expanding the variable though.
> `httpCode=$(curl -s -L ${compression} ${cmd_ext} ${heisenbergCompensator} --header 'If-None-Match: "${currentetag}"' -w "%{http_code}" -A "${agent}" "${url}" -o "${patternBuffer}" 2> /dev/null)` That will create: ```if-none-match: "${currentetag}"``` I think the logic has to...
`'if-none-match` no, i think we need to skip the heisenberg compensator if we have a non-empty etag.
Some of these files in my list are changing often. I think the current state works very well. I only got a 200 statuscode 5 out of 161 requests where...
`curl -sI -H "Host: gitlab.com" -H "user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36" -H "accept: */*" -H "if-modified-since: Fri, 23 Jul 2021 17:31:38 GMT"...