Mitchell Krog

Thanks @magicdude4eva and yes also great to see another fellow South African on here. I will see what logic I can work out regarding the robots.txt. Must first get all...

@magicdude4eva weird, I've tested the blocker on versions of Apache from 2.2 > 2.4.27 ??? Which version are you using Apache_2.2 or Apache_2.4 ??

I'd have to see how I can implement first allowing anything to access robots.txt (as per your example) and then moving into other sections of the blocker. I'm busy with...

I think I just forgot to update the include files, first regex is better

Seen this before and unfortunately unable to test or find a solution as I simply don't use cloudflare for anything. The blocker itself is more than capable of doing the...

Glad u found a partial solution ... There are some nginx setting to capture / forward real ips. I'll post those for you to try.

What version of the blocker? I have tested on 2.2 and 2.4 and it is blocked. ``` Mitchells-MacBook-Pro:GIT mitchellkrog$ curl -A "Sogou web spider/4.0" -I https://mydomain HTTP/1.1 403 Forbidden Date:...

You can unblock it yourself. Add these lines to blacklist-user-agents.conf and reload Apache ``` BrowserMatchNoCase "^(.*?)(\bsogouspider\b)(.*)$" good_bot BrowserMatchNoCase "^(.*?)(\bSogou\ web\ spider\b)(.*)$" good_bot ```

Let me know if you don't succeed

Its nothing against China, I am based in South Africa and don't want my content on Sogou which is why it was blocked from the beginning. But from the beginning...