[Bug]: Cannot read from ssl-enabled cassandra cluster
What happened?
Using Beam Version 2.53 Cassandra version is currently 3.11.5 Using cassandra-driver-core & cassandra-driver-mapping 3.10.2 (also tested on 3.11.5 but no luck)
CassandraIO.Read<T>.withSsl expects an object that implements RemoteEndpointAwareSSLOptions.
Following the datastax documentation... provide the following parameter for .withSsl: RemoteEndpointAwareJdkSSLOptions.builder().build()
And the following runtime errors will appear when you execute the pipeline:
Forbidden IOException when writing to OutputStream Caused by: java.io.NotSerializableException: com.datastax.driver.core.RemoteEndpointAwareJdkSSLOptions
Does not matter if the datastax driver config is set programmatically or property-based (following datastax documentation) - the same errors will appear once the pipeline is run.
Issue Priority
Priority: 1 (data loss / total loss of function)
Issue Components
- [ ] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [X] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner