Authentication Method for Secured Sites?

[ma26yank]

Hi, First of all, Thank you for building such a fantastic library for searching sitemaps through a website. There is a enhancement though which I would like to propose.

I have noticed for one of the site when I was trying the same thing, it asks for authentication via HttpNtlmAuth.

I was wondering if such arguments can be passed along with url to bypass authentication?

thanks