stream-reactor icon indicating copy to clipboard operation
stream-reactor copied to clipboard

Cassandra Sink connector - array to set/map

Open abratnap opened this issue 5 years ago • 2 comments

Cassandra sink connector - support populating set, map fields.

I have a JSON message which has few array fields. I want to store this in a SET/MAP field in cassandra. This doesn't work with KSQL. Expected behavior is proper fields should be populated.

CREATE TABLE IF NOT EXISTS docstore (
    id              text,
    keywords        set<text>
);

KCQL query is

INSERT INTO docstore SELECT uid as id, keywords as keywords FROM docs

input message is JSON with keywords as array field.

abratnap avatar May 05 '20 21:05 abratnap

similar issue here for avro https://github.com/lensesio/stream-reactor/issues/294

abratnap avatar May 05 '20 22:05 abratnap

seems like the support for array is required here https://github.com/lensesio/json-sql

abratnap avatar May 05 '20 22:05 abratnap