PyAirbyte icon indicating copy to clipboard operation
PyAirbyte copied to clipboard

🐛 BUG: `source-trello` `cards` stream failing

Open nabdoni opened this issue 10 months ago • 2 comments

When trying to replicate data from the cards stream of the source-trello connector, an exception is thrown:

        Marking stream cards as STARTED
    Syncing stream: cards 
    Encountered an exception while reading stream cards
    Traceback (most recent call last):
      File "/Users/CENSORED/Documents/backup_data/pyairbyte_ingest_piece/.venv-source-trello/lib/python3.10/site-packages/airbyte_cdk/sources/abstract_source.py", line 136, in read
        yield from self._read_stream(
      File "/Users/CENSORED/Documents/backup_data/pyairbyte_ingest_piece/.venv-source-trello/lib/python3.10/site-packages/airbyte_cdk/sources/abstract_source.py", line 237, in _read_stream
        for record_data_or_message in record_iterator:
      File "/Users/CENSORED/Documents/backup_data/pyairbyte_ingest_piece/.venv-source-trello/lib/python3.10/site-packages/airbyte_cdk/sources/streams/core.py", line 135, in read
        for _slice in slices:
      File 
"/Users/CENSORED/Documents/backup_data/pyairbyte_ingest_piece/.venv-source-trello/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/stream_slicers/cartesian_product_stream_slicer.py",
line 106, in stream_slices
        partition = dict(ChainMap(*[s.partition for s in stream_slice_tuple]))
      File 
"/Users/CENSORED/Documents/backup_data/pyairbyte_ingest_piece/.venv-source-trello/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/stream_slicers/cartesian_product_stream_slicer.py",
line 106, in <listcomp>
        partition = dict(ChainMap(*[s.partition for s in stream_slice_tuple]))
    AttributeError: 'dict' object has no attribute 'partition'
    Marking stream cards as STOPPED

The connector source and configuration pass .check(), and the boards stream works as intended with the same configuration.

Used configuration:

{
    "source": "source-trello",
    "config": {
        "key": "CENSORED_KEY",
        "token": "CENSORED_TOKEN",
        "start_date": "2023-03-01T00:00:00Z"
    },
    "streams": [
        "cards"
    ]
}

nabdoni avatar Apr 24 '24 09:04 nabdoni

@nabdoni - Thanks for raising this issue.

What I notice about the stack trace is that the error seems to stem from the source-trello source code itself, and not from a PyAirbyte-specific call.

~~It might be worth searching the main airbyte repo to see if anyone has reported a similar issue... 🤔~~ I checked the main repo and didn't find any similar issues with the search 'trello partition' so this doesn't seem to have been previously reported as of yet.

aaronsteers avatar Apr 27 '24 03:04 aaronsteers

cc @marcosmarxm - I see you've reviewed some other Trello PRs ~~recently~~ towards the end of last year. Lmk if you have an idea on possible root cause.

aaronsteers avatar Apr 27 '24 03:04 aaronsteers