blocking-bots topic
List
blocking-bots repositories
robots.txt
83
Stars
37
Forks
Watchers
Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites.
badbots
16
Stars
0
Forks
Watchers
Current CIDR-formatted list of unwanted bots caught on my systems.