express-limiter icon indicating copy to clipboard operation
express-limiter copied to clipboard

Whilelist phantomjs and crawlers ?

Open emathias opened this issue 10 years ago • 0 comments

Hi,

I have express-limiter in place and it works as a charm .

The question is that for SEO reasons, I'd like to whitelist: 1 - crawlers that will index the site 2 - phantomjs that I use to prerender angular pages

Do you have any experience on that ?

I have the impression that I can work a solution for the phantomjs (as it's ran locally) relying in whitelist + connection.remoteAddress. But, I cannot find a solution for crawlers (other headers ? which ?)

Thanks a lot for the help and congrats for the module, it's really great!

Best regards!

emathias avatar Nov 24 '15 11:11 emathias