Missing values in the loaded data - Freshdesk tickets

[freshprints1]

When I'm running a query to return all the tickets ever created, I see that there are a lot of missing values in the table returned. It seems to be working fine for the recent tickets (There are no missing values) but for the old data, there are just a lot of missing values and I couldn't figure out why that's happening.

I'm guessing it's something to do with how Stitch is pulling the data. I checked a few missing values on Freshdesk and they don't have any issue nor were they deleted so Freshdesk does have that data but it's just not being pulled onto Stitch.

The recent ones are working fine but there is a problem with data older than 4 months. For example, below is the sample of 10 tickets created in March 2020. I sorted the IDs so the missing numbers in the below table are the missing IDs. Does anyone know why this is happening and how we I can fix this?

Created_at	ID
15-03-2020 22:59	514928
16-03-2020 07:28	514996
16-03-2020 21:16	515219
17-03-2020 00:00	515269
17-03-2020 02:13	515301
17-03-2020 16:38	515497
17-03-2020 20:47	515616
17-03-2020 23:20	515678
18-03-2020 17:31	515895
18-03-2020 19:12	515936

[pedro-iatzky]

We faced this issue as well. We finally solved it by creating our own integration since this repo seems to be unmaintained. If you're willing to fix it in a future, the problem was because of a race condition between tickets being updated and tickets being extracted by the integration. The pagination is not being handled properly in the incremental replication methodology.

[Soulplatinum]

Hey Pedro, I am new on this and I am having the same problem with the Sittch Integration (missing tickets), how do you create your own integration? What documentation do you use? I want to pull all the fresh data to my BQ data lake but have no idea how to do it. Thanks in advance :)