pyspark-ai
pyspark-ai copied to clipboard
[Proposal] testing against both SparkSession and SparkConnect Session
Currently the code is tested only against regular spark.sql.SparkSession
. I can extend tests to spark.sql.connect.SparkSession
too; there is some difference in returned types and possible that they won't pass some type-validation. I can add all the necessary tests.