craft-seomatic icon indicating copy to clipboard operation
craft-seomatic copied to clipboard

Option to *not* submit section sitemap to search engines when content changes

Open gbowne-quickbase opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe.

We have some channels with frequent or regular changes that have a high number of URLs, so these sitemap submissions pull focus from areas of the site that we want Google to index. Think of a catalog page with a thousand items that might contain counts of reviews. When a new review comes in, this would trigger the whole catalog to be submitted again, even if the content really hasn't changed.

Describe the solution you would like

We'd like a lightswitch in the Content SEO section that would suppress the submission of content changes to search engines for that section. The sitemap should still be updated, but we'd rely on regular sitemap crawling to access these areas. A more complex version would be to apply the daily/weekly/monthly, etc. settings within Content SEO to submission frequency, but that sounds like be overkill and way too much overhead.

Describe alternatives you have considered

We've considered turning off those sections of the sitemap for a period of time and turning them back on as needed, but that requires regular human intervention and we worry about "confusing" the crawlers. We've also considered limiting the section to the most recently changed X items, but still worry we're getting enough frequent noise to these channels that we're submitting changes too frequently.

Additional context

I'd envision showing whether the sitemap is being sent upon changes on this view here, which shows a channel with >500 entries image

gbowne-quickbase avatar Aug 09 '23 14:08 gbowne-quickbase