spark

spark copied to clipboard

When trying to connect to an Azure SQL database from an Azure Databricks instance that is within a private VNET it fails with the following error: `Unhandled exception. Microsoft.Data.SqlClient.SqlException (0x80131904):...

RichardDalton

[FEATURE REQUEST]: Spark 3.2.0 Support

4

Hi Team: Are there plans to support Spark 3.2.0 that has been released recently (10-13-2021)? Specifically looking for a complete implementation of MLLib. Thanks & Regards

rrekapalli

Can spark.sql("SELECT xxx FROM xxx") be in streaming mode? Or it can just be used in batch mode? Thanks

Jaggar2018

ClassNotFoundException when using SparkBatchClient

1

My goal is to trigger a .NET Spark job programmatically. I'm following this [tutorial ](https://github.com/Azure/azure-sdk-for-net/blob/Azure.Analytics.Synapse.Artifacts_1.0.0-preview.15/sdk/synapse/Azure.Analytics.Synapse.Spark/samples/Sample1_SubmitSparkJobAsync.md), but I keep getting ClassNotFoundException (for my WordCount C# class). It works only when I...

ShahdNara

Fixes #1078: update: newtonsoft.json package reference version

3

We are excited to review your PR. So we can do the best job, please check: - [x] There's a descriptive title that will make sense to other developers some...

cutecycle

[FEATURE REQUEST]: Support for .NET 6.0

4

Hello Team, Are there plans to support .NET 6 in the future? I am currently using the newer Mac M1 processor and .NET Core 3.1 isn't supported. Thank you and...

ericjohnolson

**Describe the bug** If you include an array of values in a StructField metadata instance they will not serialize when .Json is called on the root StructType. They will however...

TrondRo

[BUG]: downloadDriverFile failing on Utils.fetchFile using microsoft-spark-3-2_2.12-2.1.0 on a 10.4 LTS (includes Apache Spark 3.2.1, Scala 2.12)

11

**Describe the bug** I am trying to upgrade my spark-submit job in azure databricks to use the newest dotnet spark version. I have upgraded the version number in db-init.sh, upgraded...

strtdusty

Use pattern matching in PayloadHelper.cs to improve readability

5

Improves the readability using c# pattern matching fixes #25

sneznaj

How to debug a server debug but not only 127.0.0.1

1

Hi, I deploy the spark env on my ubuntu 20.04 server.  there is a problem, how can I debug it on Visual Studio ,and change the default remote Ip...

robyle