azure-cosmosdb-spark
azure-cosmosdb-spark copied to clipboard
Azure
Apache Spark Connector for Azure Cosmos DB
Hi Im using Apache Spark 2.4.5, Scala 2.11. If there is any null value for a property in json, that property itself will not get written in to the db...
I am using the `azure-cosmosdb-spark connector` to write data into cosmosdb from cloudera spark cluster. The connectivity works well and the documents gets created in the cosmos db. But when...
I keep getting "This step results in a query that is not supported in DirectQuery mode." from Power BI using the spark connector to our Databricks cluster. - I've tried...
sample code ```python json_insert = '{ "id" : "1", "title" : "Rambo", "releaseDate" : "1975-12-14", "ticketPrice" : "10.345"}' df_insert = cls.spark.read.json(sc.parallelize([json_insert])) df_insert.write.format("cosmos.oltp") \ .option("spark.synapse.linkedService", "CosmosDBLinkedService") \ .option("spark.cosmos.container", "batchTestContainer") \ .option("spark.cosmos.write.upsertEnabled",...
I wanted if somebody else has run into this issue before and has suggestions to resolve it. I am trying to write a Spark data frame, which is a result...
``` py4j.protocol.Py4JJavaError: An error occurred while calling o133.load. : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3...
I am trying to upsert a file to Cosmos DB and I keep getting "Too many requests" error. **File to be upserted:** 58 MB in size with 100K records. **Configurations:**...
Hi, I am writing a Spark streaming application, in which I want to filter the data that is not in CosmosDB. I have set this column as the id column...
Hi everyone i am unable to write data to cosmos db using databricks spark cluster however i have tried all the links and solutions in stackoverflow and github and tried...
