sunny1978

@gsolasab, @squito, @gengliangwang @rxin Can some one look in to this request. We have a use case to write AVRO records to Kafka. We read some data from Kafka as...

My Row Schema: Row.Schema StructType( StructField(masterReservation,StructType( StructField(cancellationLocalTimestamp,StringType,true), StructField(cancellationNumber,StringType,true), StructField(confirmationNumber,StringType,true), StructField(confirmationUtcDate,StringType,true), StructField(createdTimestamp,StringType,true), StructField(guestProfile,ArrayType(StructType( StructField(guestFirstName,StringType,true), StructField(guestIdentifier,LongType,true), StructField(guestLastName,StringType,true), StructField(guestMember,StructType( StructField(memberIdentifier,StringType,true)),true)),true),true), StructField(imageCommittedSequenceNumber,LongType,true), StructField(imageIdentifier,LongType,true), StructField(imageStatusCode,StringType,true), StructField(imageUtcTimestamp,StringType,true), StructField(pmsConfirmationNumber,StringType,true), StructField(ratePlan,ArrayType(StructType( StructField(priceGridCode,StringType,true), StructField(ratePlanCode,StringType,true), StructField(ratePlanName,StringType,true)),true),true), StructField(reservationActivityType,StringType,true), StructField(reservationChannel,ArrayType(StructType( StructField(channelCode,StringType,true), StructField(channelRoleCode,StringType,true),...

POM: > com.lucidworks.spark spark-solr 2.0.4 org.apache.spark spark-hive_2.10 org.apache.spark spark-sql_2.10 org.apache.spark spark-csv_2.10 > com.databricks spark-avro_2.11 4.0.0 com.databricks spark-csv_2.11 1.5.0 org.apache.spark spark-hive_2.11 2.1.0.2.6.0.3-8 provided org.apache.spark spark-sql_2.11 2.1.0.2.6.0.3-8 provided >

Team Please help us on this error. Its impacting multiple flows.

Second Usecase RDBMS - JDBC Read RDBMSSource@1d610098 java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.hive.orc.DefaultSource could not be instantiated at java.util.ServiceLoader.fail(ServiceLoader.java:224) at java.util.ServiceLoader.access$100(ServiceLoader.java:181) at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377) at java.util.ServiceLoader$1.next(ServiceLoader.java:445) at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:43) at scala.collection.Iterator$class.foreach(Iterator.scala:893) at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) at...