GeorgeS2019

Results 578 comments of GeorgeS2019

@luisquintanilla We need to identify members here who are interested to maintain and merge the e.g. PR For members here who are interested, please let @luisquintanilla know. @msaltan [PR: 3.3...

@GoEddie @dbeavon @luisquintanilla Thanks for not giving up on this project. The fact that we are having this discussion is somehow sad! Microsoft can not advocate the latest AI, large...

**udfs** is not working in polyglot note book due to https://github.com/dotnet/spark/issues/1131

@AFFogarty Could you provide a working solution to make UDFs work in polyglot by working with the polyglot team => @claudiaregio Basically, it is the directory path problem associated with...

> Not having a release of this library on a supported version of dotnet is **far more damaging** than the security concerns around the Binary Serializer, and will **kill comunity...

@bmazzarol > Although the Binary Serializer can not be made safe, it's because any schema-less Serializer is equally unsafe, swapping it out for another like protobuf without the formal contract...

@bmazzarol - udf needs to run on the Spark workers - Spark workers needs to be **one of the supported languages** to work via Spark connect. - ![image](https://github.com/dotnet/spark/assets/49812372/d76cc36a-819a-4ce9-a10d-c0ad0ca8572c) Is it...

@bmazzarol I wonder if it is potentially feasible to replace the JVM part of the diagram to ikvm.NET? https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals ![image](https://github.com/dotnet/spark/assets/49812372/d3f77c25-fef2-403c-aea6-84f66bd64503)

[Initial protobuf definition for Spark Connect API](https://issues.apache.org/jira/browse/SPARK-39674)

@Vislesha What alternative(s) are you expecting?