beam icon indicating copy to clipboard operation
beam copied to clipboard

[Bug]: Cannot read from ssl-enabled cassandra cluster

Open hassanhamod opened this issue 1 year ago • 0 comments

What happened?

Using Beam Version 2.53 Cassandra version is currently 3.11.5 Using cassandra-driver-core & cassandra-driver-mapping 3.10.2 (also tested on 3.11.5 but no luck)

CassandraIO.Read<T>.withSsl expects an object that implements RemoteEndpointAwareSSLOptions.

Following the datastax documentation... provide the following parameter for .withSsl: RemoteEndpointAwareJdkSSLOptions.builder().build()

And the following runtime errors will appear when you execute the pipeline:

Forbidden IOException when writing to OutputStream Caused by: java.io.NotSerializableException: com.datastax.driver.core.RemoteEndpointAwareJdkSSLOptions

Does not matter if the datastax driver config is set programmatically or property-based (following datastax documentation) - the same errors will appear once the pipeline is run.

Issue Priority

Priority: 1 (data loss / total loss of function)

Issue Components

  • [ ] Component: Python SDK
  • [ ] Component: Java SDK
  • [ ] Component: Go SDK
  • [ ] Component: Typescript SDK
  • [X] Component: IO connector
  • [ ] Component: Beam YAML
  • [ ] Component: Beam examples
  • [ ] Component: Beam playground
  • [ ] Component: Beam katas
  • [ ] Component: Website
  • [ ] Component: Spark Runner
  • [ ] Component: Flink Runner
  • [ ] Component: Samza Runner
  • [ ] Component: Twister2 Runner
  • [ ] Component: Hazelcast Jet Runner
  • [ ] Component: Google Cloud Dataflow Runner

hassanhamod avatar Feb 08 '24 23:02 hassanhamod