scrape

scrape copied to clipboard

missing space for link text

1

Hi, appears always missing critical space for link text , example: After Democratic leaders announced they would kick off the process to begin t.. result: After Democratic **leadersannounced** they would...

shawei3000

Bumps [lxml](https://github.com/lxml/lxml) from 4.6.5 to 4.9.1. Changelog Sourced from lxml's changelog. 4.9.1 (2022-07-01) Bugs fixed A crash was resolved when using iterwalk() (or canonicalize()) after parsing certain incorrect input. Note...

dependabot[bot]

Allow scraping of domains protected by Cloudflare IUAM

1

I am unsure if this is a requested feature, but I would love to have the possibility to scrape domains that are protected by Cloudflare's I am Under Attack-Mode. This...

jobveldhuis

Examples

1

Hello huntrar, Can you give examples using scrape with arguments --attributes, --crawl, --filter or --xpath. thank you

ares-fortress

How do we name the generated index the same as the domain

1

for instance scrape www.google.com > google.html not PART01.html Also do you have an example of how to use the attributes command?

wecodelaravel

Bumps [requests](https://github.com/psf/requests) from 2.25.1 to 2.31.0. Release notes Sourced from requests's releases. v2.31.0 2.31.0 (2023-05-22) Security Versions of Requests between v2.3.0 and v2.30.0 are vulnerable to potential forwarding of Proxy-Authorization...

dependabot[bot]

It seems like this package is not set up to work out of the box, and I'm just confused about why there are unfinished relative import statements and whatnot. I've...

jpnoe