Spark Doris Connector Release Note 25.0.0
Spark Connector
Feature
Support spark datasource V2 API pushdown. #250
Support partial limit pushdown for spark 3.2 and above. https://github.com/apache/doris-spark-connector/pull/257
Improvement
Compatible with FE API changes. https://github.com/apache/doris-spark-connector/pull/260 Support create table statement for spark 3.3 and above. https://github.com/apache/doris-spark-connector/pull/264
BugFix
Fix driver exception when spark catalog gets jdbc connection. https://github.com/apache/doris-spark-connector/pull/251
Fix data conversion exception when reading date type. https://github.com/apache/doris-spark-connector/pull/253
Fix the exception of loading arrow jdbc driver when loading mysql driver. https://github.com/apache/doris-spark-connector/pull/254
Fix the problem that the column order in the schema is inconsistent with the order in the data. https://github.com/apache/doris-spark-connector/pull/256
Fix exception when reading json type data via flight sql. https://github.com/apache/doris-spark-connector/pull/263
Fix the exception of reading date type caused by turning on spark.sql.datetime.java8API.enabled configuration. https://github.com/apache/doris-spark-connector/pull/265
Spark Load
Feature
Support job execution based on object storage. https://github.com/apache/doris-spark-connector/pull/266
Thanks
@gnehil @JNSimba