Dorin Onofrei

Results 2 issues of Dorin Onofrei

Is there a way we can store JS, CSS and/or any other assets besides html with the pages.jsonl file ? I am trying to crawl everything and have a list...

Would be really great if there could be a flag that enables parent url to be also recorded into a file with crawled urls. So we can know where did...