Terry Kim comments

Results 101 comments of


                                            Terry Kim

[FEATURE REQUEST]: Dotnet Backend IPAddress

@indy-3rdman/@moredatapls Thanks for your inputs. Please feel free to take a look at #537 if you want. Thanks!

[BUG]: Error unpickling decimal array when array contains at least one '0' value

Could be a bug. Similar issue in #1006

[BUG]: Error unpickling decimal array when array contains at least one '0' value

@suhsteve Are you aware of this issue by any chance?

[FEATURE REQUEST]: Documentation to use .net for spark on Azure Synapse

Does https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/spark-dotnet help? If it's missing some details you need, please let us know. Thanks.

[FEATURE REQUEST]: Support System.Decimal in CreateDataFrame API

Hi @GoEddie, this is just waiting for development and a good issue to take.

[BUG]: spark.Dispose() and spark.Stop() throw error

Hi @akshatb1, I am trying to understand your scenario. Is there a reason why you want to close the SparkSession in an interactive session (notebook)?

[BUG]: spark.Dispose() and spark.Stop() throw error

In the interactive session, the .NET repl compiles the notebook cell code and ship it to executors (for UDF scenarios). Since the Spark session is closed, shipping the compiled code...

[BUG]: spark.Dispose() and spark.Stop() throw error

Got it. Let me talk to the team and will get back on this.

[FEATURE REQUEST]: Support StructArray as a return type in ArrowFunctions.VectorUdf

Since we have a workaround using non-arrow UDF, this is not a short-term goal, but let me talk to the team. cc @suhsteve @rapoth

[BUG]: Error while running a .net application containing a UDF against remote databricks apache spark (e.g. Azure Databricks)

@zwitbaum did you follow this https://github.com/dotnet/spark/blob/master/deployment/README.md#databricks? cc: @suhsteve @Niharikadutta @elvaliuliuliu