serialization support for Polars and Spark

[sergun]

Hi @cosmicBboy and all contributors to this great framework,

I was wondering if there are any plans to implement schema serialization for the Polars and Spark engines.

Thanks!

[cosmicBboy]

there are now! 😀

just relabeld this as an enhancement.

For anyone in the community who wants to implement this, this has my blessing!

Basically they would need to:

• implement spark_io.py and polars_io.py modules here
• rewrite the call site that's currently in the generic DataFrameSchema type: https://github.com/unionai-oss/pandera/blob/main/pandera/api/dataframe/container.py#L1243-L1254
• implement the to_json, to_yaml, from_json, to_yaml methods in the pandas/polars/pyspark-specific DataFrameSchema classes.