Aaron ("AJ") Steers

We need to document how to use BYO or already-installed connectors in PyAirbyte. A usage example is here: https://colab.research.google.com/drive/1J3yPhk6PAhDfjPOZO0k4BU1jTn2qlSjZ#scrollTo=CE-WjoScIx3R

🐛 Bug: BigQuery `to_pandas()` and `read_sql_table()` don't work

5

Discovered when working on another PR: - #144 It appears `to_pandas()` fails when run against BigQuery. > sqlalchemy.exc.InvalidRequestError: Could not reflect: requested table(s) not available in Engine(bigquery://dataline-integration-testing?credentials_path=%2Fvar%2Ffolders%2Fs2%2Fvn4r87x53fx8v_n79pxyvc_r0000gq%2FT%2Ftmpq6yf1owc) schema 'test_deleteme_c6wj0k': (users)...

Docs: Add instructions on how to use custom connectors

1

We need to document how to use custom connectors in PyAirbyte. Example notebook is here: https://colab.research.google.com/drive/1SPEmVy4xtalsxVDyAetIYoioi0oykPfp#scrollTo=ze2DPFblIXYF

Docs: Add a warning that some of our dependencies may not yet support Python 3.12 on all operating systems

1

A user ran into this issue, specifically on the Python `3.12-slim` docker image. https://airbytehq-team.slack.com/archives/C06FZ238P8W/p1712328202976869 > On the doc site I see pyairbyte should work with Python >= 3.9. It works...

🐛 Bug: Google Ads fails due to nested primary keys

4

The Google Ads source is failing due to nested primary keys. Logged here in slack: https://airbytehq-team.slack.com/archives/C06FZ238P8W/p1712842623104989?thread_ts=1712842217.390879&cid=C06FZ238P8W Example error message: - `NotImplementedError: Nested primary keys are not yet supported. Found: ad_group.id`...

This test failed randomly. Looks like an issue on Airbyte Cloud side. Logging here in case we want to implement a retry mechanism rather than hard-failure. `The server encountered a...

This is an early skeleton of what would be a native declarative source implementation in PyAirbyte. The benefit of including natively is that we can skip the installation step and...

💡 Feature Request: Ability to use database-type sources, such as `source-postgres` and `source-mysql`

7

Because most database sources are built on Java, they currently are not able to run in Python environments. This feature would allow database-type sources to be run from PyAirbyte. Possible...

This aims to assert more confidently that 'replace' strategy works as expected. So far, tests are still passing after expanding the test criteria. Here is the code in question, where...

_Originally posted by @aaronsteers in https://github.com/airbytehq/PyAirbyte/issues/131#issuecomment-2024047183_ > I did more digging and found that CI is failing the pokemon integration test, but inexplicably so. > > In CI, it uses...