wagtail-robots icon indicating copy to clipboard operation
wagtail-robots copied to clipboard

Robots.txt exclusion for Wagtail, complementing Sitemaps.

Wagtail Robots

This is a basic Django application for Wagtail to manage robots.txt files following the robots exclusion protocol, complementing the Django Sitemap contrib app_.

This started as a fork of Django Robots_ but because of the differences between the Django Admin and the Wagtail Admin, and other project requirements git history has not been retained.

For installation and configuration instructions, check out the docs_.

.. _robots exclusion protocol: http://en.wikipedia.org/wiki/Robots_exclusion_standard .. _Django: http://www.djangoproject.com/ .. _Sitemap contrib app: http://docs.djangoproject.com/en/dev/ref/contrib/sitemaps/ .. _Django Robots: https://github.com/jazzband/django-robots .. _check out the docs: https://wagtail-robots.readthedocs.io