delta-live-tables-notebooks
delta-live-tables-notebooks copied to clipboard
Issue with read_kafka within a DLT using SQL
Hi @fmunz ,
I am tying to use the read_kafka function and populate my arguments, yet somehow, whenever I try to run the code it doesn't recognize the function.
Code is written as below:
CREATE OR REFRESH STREAMING LIVE TABLE kafka_events_sql
COMMENT 'The data ingested from kafka topic'
AS SELECT
*
FROM STREAM read_kafka(
bootstrapServers => 'xxx.xxx.azure.confluent.cloud:9092',
subscribe => 'fitness-tracker',
startingOffsets => 'earliest',
`kafka.security.protocol` => 'SASL_SSL',
`kafka.sasl.mechanism` => 'PLAIN',
`kafka.sasl.jaas.config` => 'kafkashaded.org.apache.kafka.common.security.plain.PlainLoginModule required username="xxx" password="xxx";'
);
The output that I get when running is below:
I am trying really hard to understand what is the issue and why this function wouldn't work no matter what i did.