python-sitemap-generator
python-sitemap-generator copied to clipboard
Crawl any Web page and generate XML sitemap compatible with Google's indexing robots.
It seems to try to crawl mailto links. For example if http://www.foo.com/contact has a `Email Us!` link, it will try to go to http://www.foo.com/[email protected]
Remove unused imports, add Entry point check and CLI arguments support, remove hardcoded values
comment out or remove from var_dump import var_dump use pprint instead
Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/home/rcescon/python-sitemap-generator.py", line 212, in run temp_res = urlopen(temp_req) File "/usr/lib/python3.10/urllib/request.py", line 216, in urlopen return opener.open(url, data,...
In this fork, I tried to enhance the readability and structure of the project. Moreover, to enhance using experience I have provided a `requirements.txt` file and a CLI to run...
Hi, you're missing a dependency in your list which is not available by default. Why don't you instead include a requirements.txt file as per Python standards? lxml Also, you need...