Willi Müller

rest_api: Clarify how we specify incremental loading

6

### Source name rest_api ### Describe the data you'd like to see Currently, the declarative rest_api source offers two APIs to specify incremental data loads: 1. declaring one parameter of...

Feat/1331 disables deduplication for incremental

1

### Description This PR disables deduplication for the test case described by ingestr here: https://github.com/dlt-hub/dlt/issues/971#issuecomment-1983417044 ### Related Issues - Resolves #1131 ### Questions @rudolfix 1. I could not understand your...

show full HTTP response on failure (Feat/1605)

1

### Description This PR implements error logging of the full HTTP response on error when the `dlt.sources.helpers.requests.Session` is used. Unless a custom session with different configuration is used, all HTTP...

logs warning if deduplication state is large

1

### Description As a first step towards resolving this issue: warns if the deduplication state grows over a large count of hashes of the primary key. ### Related Issues [#1131...

Feat/557 rest api add oauth2clientcredentials to built in auth methods

1

### Description - Adds `oauth2_client_credentials` to auth shorthand in the RESTAPIConfig - masks the secrets of aouth2 config dict during dict validation ### Related Issues - Resolves #1870

rest_api: Clarify how we specify incremental loading

6

### Source name rest_api ### Describe the data you'd like to see Currently, the declarative rest_api source offers two APIs to specify incremental data loads: 1. declaring one parameter of...

rest_api: Allow multiple resolve params in an endpoint config

4

### dlt version 0.4.11 ### Source name rest_api ### Describe the problem When trying to specify multiple resolve params I get the following exception: ``` demos-py3.11➜ demos git:(main) ✗ RUNTIME__LOG_LEVEL=INFO...

### dlt version 0.5.4 ### Describe the problem If users supply an auth object which is not an instance of `dlt.sources.helpers.rest_client.auth.AuthConfigBase` then `rest_api.create_auth` returns `None`. It also returns `None` if...

rest_Add `OAuth2ClientCredentials` to the current list of built-in auth methods. This requires changes only in the dlt-core repo in rest_client/auth.py ### Tasks: - [x] in sources/rest_api/typing.py: add AuthType, add OAuth2Config...

### Feature description Right now, we require the initial_value, end_value, and last_value_func in IncrementalArgs to be str. Changing existing test cases to `int` also proves that this is supported. Probably...