jitsu icon indicating copy to clipboard operation
jitsu copied to clipboard

Repeated eventn_ctx_event_id with Bing Ads source.

Open icychocolate98 opened this issue 3 years ago • 1 comments

Good morning,

I think I found an issue with Bing Ads source, when I'm trying to download aggregated reports (daily) it seems that there is a problem with column eventn_ctx_event_id. It repeats the same eventn_ctx_event_id depending on "devicetype" and if it let Jitsu create automatically the tables it overrides my events due to ReplacingMergeTree engine.

I solved it temporarily by creating the tables manually with MergeTree engine (will be a problem if I run full-refresh later) and it works fine, but every row groupped by "devicetype" has the same "eventn_ctx_event_id".

As you can see here, this events should have different eventn_ctx_event_id but they have the same depending on decivetype. image

Adding campaignid to Group By clause: image

I hope this helps!

icychocolate98 avatar May 19 '22 09:05 icychocolate98

We generate eventn_ctx_event_id based on primary keys fields provided by source. In case of Bing - it is airbyte implementation. Bing Airbyte Source currently returns the following set of key fields for reports stream: ["TimePeriod", "Network", "DeviceType"] which misses the main entity id like "Campaing ID"

I’ve created a bug report in airbyte repository: https://github.com/airbytehq/airbyte/issues/13032

absorbb avatar May 19 '22 16:05 absorbb