web-poet icon indicating copy to clipboard operation
web-poet copied to clipboard

Web scraping Page Objects core library

Results 38 web-poet issues
Sort by recently updated
recently updated
newest added

## Background Following the acceptance of https://github.com/scrapinghub/web-poet/pull/27, developers could now use URL patterns to declare which Page Objects would work on specific URL patterns ([reference code](https://github.com/scrapinghub/web-poet/pull/27/files#diff-28986a071b3d856ca1ef15cb80b1390bdb551aef42f5caffa4d7d12acfeae301R57-R80)). ## Problem For large...

enhancement

Stemming off from this PR: https://github.com/scrapinghub/web-poet/pull/22 The main motivation for this is for developers to easily create `HttpRequestBody` and `HttpRequest` instances from both **bytes** and **unicode strings**.

The changes from this PR was taken directly from https://github.com/scrapinghub/web-poet/pull/23 in order to have a separate discussion regarding how to better validate the Meta values (and keys). The original discussion...

Built on top of https://github.com/scrapinghub/web-poet/pull/22. --- - [ ] Docs - [ ] Changelog - [ ] Move existing `RequestBackendError` to this new module

Built on top of the branch from https://github.com/scrapinghub/web-poet/pull/27 which aims to define the minimum specifications/requirements to be a POP.

Built on top of https://github.com/scrapinghub/web-poet/pull/28 which introduces a way to **export** a new `PageObjectRegistry` instance which only contains the rules found in the POP package. ### TODO: - [ ]...

This issue aims to discuss customizable arguments to injected dependencies as proposed by @gatufo. This is in-line with the idea proposed in https://github.com/scrapinghub/web-poet/issues/18. ---- The idea is to create a...

enhancement

I've tried to simplify ApplyRule docstring, and also added an introduction for the Overrides (renamed to Apply Rules). It seems overrides.rst might need a bit more cleanup (it became not...

Addresses **approach 1** of https://github.com/scrapinghub/web-poet/issues/77 # TODO: - [x] Documentation overhaul - [x] docstrings - [x] tutorials - [x] overriding `to_return` item using `@handle_urls` - [x] Consider renaming `OverrideRule` to...