opensearchserver icon indicating copy to clipboard operation
opensearchserver copied to clipboard
verified publisher icon jaeksoft

sitemap.xml fetch frequency

Open futureweb opened this issue 9 years ago • 3 comments

Hello, OSS is really HAMMERING our Server with requests for sitemap.xml ... how can I adjust the fetch frequency for it?

83.65.0.0 - - [25/Nov/2016:13:19:01 +0100] "GET /sitemap.xml HTTP/1.1" 200 3394 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:01 +0100] "GET /sitemap.xml HTTP/1.1" 200 891 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:02 +0100] "GET /sitemap.xml HTTP/1.1" 200 535 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:03 +0100] "GET /sitemap.xml HTTP/1.1" 200 1684 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:04 +0100] "GET /sitemap.xml HTTP/1.1" 200 1483 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:04 +0100] "GET /sitemap.xml HTTP/1.1" 200 667 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:04 +0100] "GET /sitemap.xml HTTP/1.1" 200 607 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:04 +0100] "GET /sitemap.xml HTTP/1.1" 200 2060 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:05 +0100] "GET /sitemap.xml HTTP/1.1" 200 1337 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:05 +0100] "GET /sitemap.xml HTTP/1.1" 200 1157 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:05 +0100] "GET /sitemap.xml HTTP/1.1" 200 426 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:06 +0100] "GET /sitemap.xml HTTP/1.1" 200 3393 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:07 +0100] "GET /sitemap.xml HTTP/1.1" 200 891 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:07 +0100] "GET /sitemap.xml HTTP/1.1" 200 535 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:08 +0100] "GET /sitemap.xml HTTP/1.1" 200 1684 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:09 +0100] "GET /sitemap.xml HTTP/1.1" 200 667 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:09 +0100] "GET /sitemap.xml HTTP/1.1" 200 1483 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:09 +0100] "GET /sitemap.xml HTTP/1.1" 200 607 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:09 +0100] "GET /sitemap.xml HTTP/1.1" 200 2060 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:10 +0100] "GET /sitemap.xml HTTP/1.1" 200 1337 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:10 +0100] "GET /sitemap.xml HTTP/1.1" 200 1156 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:10 +0100] "GET /sitemap.xml HTTP/1.1" 200 426 "-" "OpenSearchServer_Bot" 83.65.0.0 - - [25/Nov/2016:13:19:11 +0100] "GET /sitemap.xml HTTP/1.1" 200 3394 "-" "OpenSearchServer_Bot"

Thank you, bye from Austria Andreas Schnederle-Wagner

REF: https://sourceforge.net/p/opensearchserve/discussion/947148/thread/180f1b13/

futureweb avatar Nov 25 '16 12:11 futureweb

@emmanuel-keller - is there any ETA when you release 1.5.15 with this Bug fixed? thx

futureweb avatar Mar 28 '17 13:03 futureweb

End of hammering ! Sorry, it was really long. We just released the patch. We added a cache for the sitemap. By default, a sitemap is stored for 15 minutes. It is still possible to reload the sitemap by either restarting the OSS or using the user interface.

A nightly build is available here. http://www.open-search-server.com/ftp/OpenSearchServer_1.5/build-b9cf469/

emmanuel-keller avatar Apr 02 '17 20:04 emmanuel-keller

alright - just updated - seems like the Sitemap Hammering is History ... thx for finally fixing it! :)

futureweb avatar May 05 '17 09:05 futureweb