robots-exclusion-protocol topic

grobotstxt is a native Go port of Google's robots.txt parser and matcher library.

jimsmart

Manage the robots.txt from the Kirby config file

bnomei

Generate an XML sitemap for a GitHub Pages site using GitHub Actions

cicirello