jitsu icon indicating copy to clipboard operation
jitsu copied to clipboard

Trigger webhook when there is a DDL change for ClickHouse

Open azhard4int opened this issue 3 years ago • 0 comments

Problem

What problem this feature is going to solve. Why this problem is important

Currently, we need to watch the Clickhouse tables with their columns on our end to create materialised views when there is a change to the columns and recreate materialised views. Jitsu is doing the same thing on server side, it drops and recreates a table.

If there is a DDL operation performed for Clickhouse, sending a webhook along with table name would let us recreate materialised views.

Solution

Proposed solution: architecture, implementation details etc

On Jitsu server side, when we perform a DDL operation if there is a column change, send a Webhooks to the destination/provided URL so that we can trigger the materialised view process on our end.

azhard4int avatar Apr 11 '22 07:04 azhard4int