doris-spark-connector icon indicating copy to clipboard operation
doris-spark-connector copied to clipboard

Spark Doris Connector Release Note 25.0.0

Open JNSimba opened this issue 1 year ago • 0 comments

Spark Connector

Feature

Support spark datasource V2 API pushdown. #250

Support partial limit pushdown for spark 3.2 and above. https://github.com/apache/doris-spark-connector/pull/257

Improvement

Compatible with FE API changes. https://github.com/apache/doris-spark-connector/pull/260 Support create table statement for spark 3.3 and above. https://github.com/apache/doris-spark-connector/pull/264

BugFix

Fix driver exception when spark catalog gets jdbc connection. https://github.com/apache/doris-spark-connector/pull/251

Fix data conversion exception when reading date type. https://github.com/apache/doris-spark-connector/pull/253

Fix the exception of loading arrow jdbc driver when loading mysql driver. https://github.com/apache/doris-spark-connector/pull/254

Fix the problem that the column order in the schema is inconsistent with the order in the data. https://github.com/apache/doris-spark-connector/pull/256

Fix exception when reading json type data via flight sql. https://github.com/apache/doris-spark-connector/pull/263

Fix the exception of reading date type caused by turning on spark.sql.datetime.java8API.enabled configuration. https://github.com/apache/doris-spark-connector/pull/265

Spark Load

Feature

Support job execution based on object storage. https://github.com/apache/doris-spark-connector/pull/266

Thanks

@gnehil @JNSimba

JNSimba avatar Feb 20 '25 06:02 JNSimba