Terry Kim comments

Results 101 comments of


                                            Terry Kim

Add Binarizer

Hi @SARAVANA1501, are you still interested in finishing up this PR? Thanks!

Launch dotnet backend jvm bridge process ondemand

Thanks @laneser for the PR. However, I am not fully convinced with this approach: - This requires another set of documentation: e.g., it will not work if `SPARK_HOME` is not...

Expose logger for override by consumer

@sunildixit The reason was to fix this in a right way: https://github.com/dotnet/spark/issues/473#issuecomment-643663712 There is a workaround if you need to access these: https://github.com/dotnet/spark/issues/473#issuecomment-608260897

Adding Hardware acceleration version of Queries 1 and 8 in csharp

#291 should unblock this when it's merged to master.

Email search scenario tests of using dotnet spark as reducers

@ruihmicrosoft, we have been adding examples with some documentations under the example folder: #319, #320. If you want to push forward this PR, can you please convert this to an...

Created Ubuntu Dockerfile for .NET Spark

@johnpaulada You can create `docs/Docker.md`. And update https://github.com/dotnet/spark/blob/master/docs/getting-started/ubuntu-instructions.md to have a link to it. Thanks.

[FEATURE REQUEST]: Graphx Support

@superboy1984 we don't have a plan to support Graphx at the moment, but any contribution is welcomed!

Running job in DeployMode = Cluster in GCP

Can you check if `createSession` is being called in your application? (I assume it's a function?)

Using custom connectors written in C#

Hi @sjahongir, the scenario you described (using C# connector) is not supported, since .NET for Apache Spark is more like a wrapper around Apache Spark. This means that the connector...

[BUG]: .Net Interactive: UDF use deprecated BinaryFormatter, fail in VS Code

Thanks @oefe for reporting this. We will move away from `BinaryFormatter` from upcoming releases.