mongo-spark
mongo-spark copied to clipboard
The MongoDB Spark Connector
When I try to write a databricks data frame with `DateType` to mongodb, I got `Error: Cannot cast 2022-05-13 into a BsonValue. DateType has no matching BsonValue. Error: java.sql.Date cannot...
SPARK-343: More save methods in MongoSpark accepting MongoConnector as argument
* upgrade to spark 3.2.0 and scala 2.13.7 * upgrade to sbt 1.5.5 (needed because sbt-scoverage for scala 2.13.x required it) * introduced build.sbt * remove scalariform (not supported anymore,...
description on this JIRA ticket: https://jira.mongodb.org/browse/SPARK-314
'upsertDocument' flag passed as spark option control the insert behavior (provided if 'forceInsert' is set to false) If true - MongoSpark behavior the same as earlier i.e. inserts / updates...
[SPARK-413](https://jira.mongodb.org/browse/SPARK-413)
Adds the `mode` configuration allowing for different parsing strategies when handling documents that don't match the expected schema during reads. The options are: - `FAILFAST` (default) throw an exception when...
A `$sample` based partitioner that provides support for all collection types. Supports partitioning across single or multiple fields, including nested fields. The logic for the partitioner is as follows: -...