Robots.txt?

Open natebenes opened this issue 15 years ago • 1 comments

Is there a way to specify a robots.txt file?

Oct 12 '10 00:10 natebenes

Just put a robots.txt in your /public and map a static rack URL in your config.ru file, i.e:

config.ru Line 5: use Rack::Static, :urls => ['/css', '/js', '/images', '/favicon.ico', '/robots.txt'], :root => 'public'

Dec 28 '10 01:12 daviding