Option to crawl different public URL

[michelnyx]

Hello!!

I've an issue with an private website, I make changes but when the APP crawnls, simply all changes I make isn't delivered to ZIP file.

It's because the app is looking for public URL instead of my private URL (and the server running the wordpress instance have access to this private URL).

Just an option to give what're the base URL it crawnls just solve this issue!!

Please add this option, thanks a lot!!

Best Regards,

[michelnyx]

For solve this problem now, I changed this file / line as following:

I hope we've an option in GUI to it.

Thanks.

[leonstafford]

Hi @michelnyx,

Could you please tell me a bit more info about your "private" URL, ie structure, if it was not http://localhost?

This is a recurring request by users, but there's potential for things to break if I'm relying on the crawl URL to be the same as used during main URL rewriting functions.

In this case, it sounds like you're using a load balancer or proxy to serve a different URL? Ideally, in this case, you'd setup your WordPress development site to use the internal/private URLs. This will speed up crawling, too, as it doesn't need to take the long route to public URL and back to private on each request.

You don't need to share me any of your private information, but if you can describe your setup in more detail, that will give me a better idea.