Verifying and Consuming DuckDuckBot IP Addresses

Open rsiddle opened this issue 9 months ago • 0 comments

I'm working on a project to expand search engine crawling outside the Google and Bing ecosystem. While I understand that DuckDuckGo uses Bing, amongst other sources, the DuckDuckBot is occasionally used.

The IP addresses listed in the DuckDuckBot documentation make it difficult to verify if they are in active use.

Performing a reverse DNS does not return a DuckDuck related hostname.

~ host 57.152.72.128
Host 128.72.152.57.in-addr.arpa. not found: 3(NXDOMAIN)

If that list is maintained, it would be helpful if it could be provided in a JSON format, similar to Bing and Google so that Infosec teams can ingest it on a regular cadence.

https://www.bing.com/toolbox/bingbot.json https://developers.google.com/static/search/apis/ipranges/googlebot.json https://developers.google.com/static/search/apis/ipranges/special-crawlers.json https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers.json https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers-google.json

Mar 11 '25 11:03 rsiddle