delta-live-tables-notebooks icon indicating copy to clipboard operation
delta-live-tables-notebooks copied to clipboard

Issue with read_kafka within a DLT using SQL

Open zmsoft opened this issue 1 year ago • 0 comments

Hi @fmunz ,

I am tying to use the read_kafka function and populate my arguments, yet somehow, whenever I try to run the code it doesn't recognize the function.

Code is written as below:

CREATE  OR REFRESH STREAMING LIVE TABLE kafka_events_sql
  COMMENT 'The data ingested from kafka topic'
  AS SELECT
    *
  FROM STREAM read_kafka(
    bootstrapServers => 'xxx.xxx.azure.confluent.cloud:9092', 
    subscribe => 'fitness-tracker',
    startingOffsets => 'earliest',
    `kafka.security.protocol` => 'SASL_SSL',
    `kafka.sasl.mechanism` => 'PLAIN',
    `kafka.sasl.jaas.config` => 'kafkashaded.org.apache.kafka.common.security.plain.PlainLoginModule required username="xxx" password="xxx";'
  );

The output that I get when running is below:

image

I am trying really hard to understand what is the issue and why this function wouldn't work no matter what i did.

zmsoft avatar Jan 11 '24 05:01 zmsoft