Aaron ("AJ") Steers

As raised in a recent discussion with target developers, the developer experience regarding merge insert support is confusing. We can add developer documentation and/or update to the cookiecutter with more...

Generic SSH support for SQL-based taps and targets

2

The goal would be able to support SSH for SQL-based connectivity. Possibly could be implemented as an extension to the `SQLConnector` class. A sample implementation from `tap-mysql` is here: https://github.com/transferwise/pipelinewise-tap-mysql/commit/2f1b0fd4c69a440350c2a92ad2fef8bd417c080e...

Option in SQL Targets to coerce types based on observed record shape

5

This would be a simple-to-use option for end users who are trying to deal with "rogue" or incorrect type declarations in the upstream tap. For instance, if the tap incorrectly...

For SQL taps, add support for `custom_queries`

4

Sometimes DB table columns does not support exactly the correct properties we want to query. For instance, a table having `updated_at` and `created_at`, where `updated_at` is null until a post-creation...

Feature: Option to obfuscate URL path if any part is sensitive

2

### Feature scope Taps (catalog, state, stream maps, etc.) ### Description In #785, we began printing the entire URL path when an error occurs, where previously we had only printed...

Add paradigm for stream filter constraints and max_records constraints

4

Currently, developers are left to inspect `self.replication_key`, `self.get_starting_replication_key_value()`, `self.get_starting_timestamp()` themselves, within `get_records()` or `get_batches()`. This isn't great for a number of reasons. To make the filters expected much more explicit,...

Feature: Ability for taps to use batch messaging only on select streams

4

### Feature scope Taps (catalog, state, stream maps, etc.) ### Description This feature would allow more control over when batching is used. I'll list a few approaches for discussion, but...

Improve rendering of WIP Cookiecutter Readmes

3

In the wild, we're seeing a lot of taps and targets that still have "`Developer TODO:`" blocks in the public facing readme. Let's clean these up so the developer todos...

Running multiple copies of PyAirbyte for the same stream will lead to errors

2

PyAirbyte should be able to be run multiple times simultaneously _except_ for these conditions: 1. Loading the same stream at the same time with two PyAirbyte instances is not supported....

WIP: resolve bigquery cache datetime format issue

12

Reported in slack: - https://airbytehq-team.slack.com/archives/C06FZ238P8W/p1723145063648579?thread_ts=1723118180.084029&cid=C06FZ238P8W Log from repro in new "example" script: ` google.api_core.exceptions.BadRequest: 400 Error while reading data, error message: JSON table encountered too many errors, giving up. Rows:...