pyspark-ai icon indicating copy to clipboard operation
pyspark-ai copied to clipboard

[Proposal] testing against both SparkSession and SparkConnect Session

Open SemyonSinchenko opened this issue 1 year ago • 0 comments

Currently the code is tested only against regular spark.sql.SparkSession. I can extend tests to spark.sql.connect.SparkSession too; there is some difference in returned types and possible that they won't pass some type-validation. I can add all the necessary tests.

SemyonSinchenko avatar Feb 27 '24 13:02 SemyonSinchenko