pulsar-spark

pulsar-spark copied to clipboard

Describe the solution you'd like; - Please bump the spark version to v.3.5. List of GCP Dataproc Serverless Runtime versions users want to test, **2.2 (Spark 3.5, Java 17, Scala...

yash2

### Motivation Since you haven't updated Readme, we have spent so long time to found out how to read data within specific range. Thankfully, we found options(`startingTime` ,`endingTime`) to solve...

violetkjs

I have search all the internet to configure subscription to Shared. But I haven't found it yet. All I know is that since setting subscriptionType in java client requires Class...

moweonlee

**Describe the bug** When we configure the option `maxBytesPerTrigger` for our Spark job that reads from a Pulsar topic it won't start. It crashes with this error: ``` ERROR MicroBatchExecution:...

ronaldbuit

**Describe the solution you'd like** A clear and concise description of what you want to happen. Currently spark uses exclusive type, how can we change the type of it.

Naveen-8451

I am streaming CDC messages from PostGRES using the [PostGRES Debezium Connector](https://pulsar.apache.org/docs/3.1.x/io-cdc-debezium/#example-of-postgresql). The topic has the following schema ``` "type": "KEY_VALUE", "timestamp": 1695369844027, "properties": { "key.schema.name": "KafKaJson", "key.schema.properties": "{\"__AVRO_READ_OFFSET__\":\"0\"}", "key.schema.type":...

oneebhkhan

[FEATURE] maxTriggerDelay feature in Pulsar-Spark Connector

6

**Is your feature request related to a problem? Please describe.** I am consuming data from Pulsar through Spark Structure Streaming in micro-batches. Right now, what happens is that spark consumes...

keenborder786

I am interested in knowing if I can use the same configurations given in the readme file for source connector implementation. [](https://github.com/streamnative/pulsar-spark#readme) Additionally, I am wondering if there is a...

divya-nsurely

[FEATURE] Do Scala Style via CI workflow by GitHub Actions

1

**Is your feature request related to a problem? Please describe.** PRs are not verified with scala style requirement which causes failure until release. **Describe the solution you'd like** Add a...

nlu90