Ildar Nurislamov
Ildar Nurislamov
### Problem Some API that Jitsu uses to pull sources data applies quota limits for allowed requests per period of time. If quota limit get exceeded during source sync Jitsu...
### Problem We have to little metrics to be sure that application is healthy and there are no regressions after upgrading to a new version ### Solution For every significant...
### Problem - Currently Jitsu retries error infinitely - that doesn't make much sense because many kind of errors cannot be solved with retries. - For streaming storages error leads...
### Problem Facebook often upgrade API version without breaking compatibility. Nonetheless previous API endpoint stops working ### Solution Find a way to detect current version of Facebook API Introduce service...
### Problem Currently patchTable checks difference between table schema in destination and table schema derived from data. But it ignores column type difference completely. So if column types differ we...
Problem of current design: * Events routing in Jitsu is hardcoded. * Also many components are hardwired. E.g. http handlers and destinations * Only 2 implementation of events queue supported:...
We need to officially support k8s: * Under k8 environement: Run airbyte source images as k8s pods instead of using DinD of DoD approaches * Add documentation with example of...
## The problem Destinations like BigQuery, Snowflake, Redshift in batch mode use GCS or S3 as an intermediately storage for batches. Instead of multiple inserts Jitsu uses `COPY` (or equivalent)...
## Steps to reproduce Sync database source with more than one table. and events number in first table > airbyte batch size. ## Expected behavior All table cleared properly before...
We need to find a way to respect google ads api quotas keeping in mind multiple node configuration