Steve Suh

Looks like builds are failing. Can you look into it ?

@KarpagamGurumurthy how are you running your .NET Spark application in Azure Functions? Are you attempting to run the manually run the application binary? ie, `.exe` or are you using `spark-submit`...

@NoobCo3 can you refer to #785 ? You'll need a `runner` class that implements `ExternalCommandRunner` on the JVM side.

@akamor Please take a look at the following SPIP [SPARK-26257](https://issues.apache.org/jira/browse/SPARK-26257) as to why we've had to use python serialization in order to integrate with the current Spark Interop layer. We've...

@aslot in your `Additional context` section you listed that you ran ```bash export DOTNET_ASSEMBLY_SEARCH_PATHS="/home/lovelake/dotnet.spark/artifacts/bin/Microsoft.Spark.CSharp.Examples/Debug/netcoreapp3.1/ubuntu.21.04-x64/publish:$DOTNET_ASSEMBLY_SEARCH_PATHS" ``` The `:` was set there. The search paths should be separated by `,`s instead of...

> @suhsteve Are you aware of this issue by any chance? No sorry I'm unaware of this issue. But it seems like @akamor has a lead. If the fix makes...

Looked into this a bit more. Haven't tested this but I think we can just create our own custom [DecimalConstructor](https://github.com/irmen/Pyrolite/blob/3e715b65daa8f00f39b2ad6f3446a2fa8f0707db/dotnet/Razorvine.Pyrolite/Pyrolite/Pickle/Objects/DecimalConstructor.cs#L13) and register the constructor with the Unpickler.

@akamor Glad it's working out for you. The steps you outlined is pretty much what I had in mind. Would you like to contribute the fix as a PR? I...

> Out of curiosity, why was the registration needed in both Program.cs and in the SparkSession constructor? I would've assumed it would only be needed in Program.cs I think it'll...

@rolevin I suspect there may be something fishy in your Nuget.config ? The error message seems to suggest issues connecting to https://dynamicscrm.pkgs.visualstudio.com/_packaging/SalesInsights/nuget/v3/index.json