jitsu
jitsu copied to clipboard
jitsucom
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
## Problem Obtaining secrets & tokens for connectors is a pretty time-consuming task. The user should click-through pretty sophisticated interfaces. We need to implement OAuth where it's possible. ## Solution...
### Problem Kafka is a very popular message broker system. We want to listen to messages from Kafka's topic. ### Solution ``` sources: kafka1: type: kafka server: "address:port" topic: mytopic...
[Migrate from legacy version](https://github.com/jitsucom/en-legacy/blob/9d8a8c4ec3e48a6c35ee2c179d0084b2b0bb8170/commons-services/src/main/java/kplatform/apidb/connections/GoogleAdSenseConnection.java)
Migrate legacy [Shopify Driver](https://github.com/jitsucom/en-legacy/blob/main/commons-services/src/main/java/kplatform/apidb/connections/ShopifyConnection.java).
### Problem EventNative should support [AppsFlyer](appsflyer.com) as a source. ### Solution Implement [AppsFlyer API](https://support.appsflyer.com/hc/en-us/articles/207034346-Using-Pull-API-aggregate-data) driver.
In case when server.name isn't specified in EventNative config, we should read it from a file (from app/res folder) and if the file doesn't exist -> create a new one...
### Problem There is no way to configure enrichment rules yet ### Solution Example of destination JSON configuration with enrichment rules: ```json { "$type": "PostgresConfig", "_comment": null, "_connectionErrorMessage": null, "_connectionTestOk":...
### Problem There is no way to configure Eventnative enrichment rules using en-manager ### Solution en-manager backend must add enrichment rules to destinations. Config example: ```json { "destination_id": { ......
### Problem To simplify some system operations like data migration and so on, which require immutability of backend data, it's nice to have some way to make configurations read-only or...