Ján Regeš

Thank you for that suggestion, @bugnumber9. I have been considering this and other functionality for some time. However, caring for my son and work will not allow me to add...

Hi @hanoii. Adding a configuration file option is a good idea. It can save the need to define a lot of CLI parameters. It would help me if you could...

Hi @dvlp123456, to fix the last 2 cases, please try the current version from the main branch where I just pushed the fix. If you are using crawler in WSL,...

Please try using `ping yourdomain.xyz` to find out the IP address of this site (e.g. 1.2.3.4) and then add `--resolve='yourdomain.xyz:443:1.2.3.4'`. This will bypass possible problems related to DNS resolving. More...

Hi @Nicram-Badatflyski, I'm glad our tool helps you ;) Local domain name resolution is handled differently on different platforms and SiteOne Crawler cannot respond correctly in all cases. In this...

Hi @ryanw2G, I'm glad my tool helps you ;) A few questions I have: * if you run the crawler repeatedly, does it always crash/end at the same URL? *...

Hi @GitHub-Mike, please provide sample URLs directly from the HTML code of the source website. I need to know if this is related to query strings and the recently added...

Hi @GitHub-Mike a @nilocky, In the current main branch and in the upcoming release version 1.0.9 (in the next few hours) there is a new version of URL handling and...

Hi @GitHub-Mike, the tool was not created with the aim of being a tool only for SEO, but to be usable for crawling, analyzes of all kinds and at the...

@GitHub-Mike, I understand now. Thank you. The main reason why I decided to replace query parameters with a short, but unique enough hash, is the limitation on the length of...