craft-seomatic icon indicating copy to clipboard operation
craft-seomatic copied to clipboard

[FR] - IndexNow Support

Open bryandugan opened this issue 1 year ago • 12 comments

Our SEO agency advised me to add IndexNow to my Craft Websites. Bing Webmaster Tools recommends that it get set up for faster indexing.

I would like to have a straightforward connector setup that will write to IndexNow each time a page is published, updated, or deleted, though I see some issues with getting it set up due to the setup forcing users to add a txt file to the web index. Maybe have some quick documentation to get users to add the file to the web index before enabling?

This could be setup as a custom module on my end, but I feel it would be better to have it included in SEOMatic. There is an official plugin that Microsoft Created for WordPress, and it looks like Yoast, and other popular plugins also have it baked in.

bryandugan avatar Feb 12 '25 14:02 bryandugan

I might consider adding this at some point; I'm just unsure how popular Bing is as a search engine.

As of January 2025, Bing's market share was: Global desktop search: 12.23% US search engine: 7.85% In January 2025, Google had the largest share of the global desktop search market at 78.83%

khalwat avatar Feb 12 '25 17:02 khalwat

Thanks for considering looking into it! I agree with what you're saying. I've also completely ignored supporting Bing until this year. During my annual reporting, I was surprised to find about 20% of our site search traffic is from Bing (from GA4). The main reason why I was asked to consider adding IndexNow and supporting Bing was that ChatGPT uses Bing as its default search.

bryandugan avatar Feb 13 '25 15:02 bryandugan

Had this exact request a week ago; Seems the rise of LLMs and the idea that Bing is being used under the hood by a lot of these would make a pretty solid case that this will increase in importance (even though it will not take over Google any time soon).

jan-dh avatar Feb 26 '25 09:02 jan-dh

Fair. Although LLMs don't offer any reciprocity in terms of backlinks or attributes, and thus many people are actively banning them via robots.txt

khalwat avatar Feb 28 '25 00:02 khalwat

Yep, I guess that's a strategic choice of the marketing team; however, some companies do find it important to appear in the search results next to their competitors and want to optimise for that.

jan-dh avatar Feb 28 '25 08:02 jan-dh

Where do they appear next to their competitors in search results with LLMs tho @jan-dh ? Or do you mean on Bing itself?

khalwat avatar Feb 28 '25 19:02 khalwat

No I mean, as a company selling stuff you want to appear in AI searches, even though they don't offer reciprocity in terms of backlinks or attributes. If all of your competitors appear there, you want to be there too.

jan-dh avatar Feb 28 '25 19:02 jan-dh

Are there contexts where your company or your company's products will appear in AI results in this manner? I've yet to see it, but if so, that would be a compelling reason to add it as a feature.

khalwat avatar Feb 28 '25 19:02 khalwat

The ChatGPT AI search function uses Bing index to show results as feature snippet with links to websites as sources. For affiliate websites it is important to be included there in my opinion, regardless if you want or not...!

tibbis avatar Mar 04 '25 23:03 tibbis

+1 here.

It's really the speed of having your content being "Indexed Now", and then OpenAI's tooling using Bing to conduct search, which can provide link references (whether natively or requested by a prompt).

I'd say this is worth a look @khalwat. Seems like Craft's Messaging Queue can make this a reality by sending a Job for entry updates to notify Bing.

We're looking into implemented this ourselves, so I'll post back with what we find along the way.

curtismorte avatar Apr 03 '25 18:04 curtismorte

@khalwat did you have a think about this? Worth implementing?

jan-dh avatar May 20 '25 07:05 jan-dh

Yep, I think it's likely worth doing.

khalwat avatar May 27 '25 01:05 khalwat