Pascal Essiembre

See here: https://opensource.norconex.com/crawlers/web/v3/migration

One solution could be to define two crawlers, one with the URL normalization to always use ``www`` and the other without the ``www``. Then you would have to test each...

Plenty of good ideas. I just marked this as a feature request.

The WebDriverHttpFetcher does not really offer ways to directly interact with Selenium. Instead, it lets you write JavaScript that can simulate user behaviour. In your case, you seem to want...

What type of code sample are you looking for? We try to make the HTTP Collector easy to extend and work with for coders, but it is used by most...

JSON files will get crawled. Can you elaborate on what you are trying to do exactly? If you mean parsing a JSON file so some fields can be stored as...

What do you want to do with the information? Store each field/value in a separate field in your database or search engine? Something else? I suggest you look at available...

Without ways to reproduce it is hard for me to comment, but looking at your log snippet, nothing indicates the redirect is not being crawled. Understanding these two lines from...

Do you by any chance have or know of a public login form with a test/demo account we can use to start on this?

I am marking this as a feature request. It will likely remain open until we can get our hands on a public SiteMinder site we can use for testing/implementing this....