Niels Bantilan

@aaravind100 it looks like the underlying error is: ``` NotImplementedError: Converting strings to map is not implemented ``` It looks like this test case needs to be updated to contain...

thanks @aaravind100 !

Thanks for unearthing this @jcadam14 ! would you mind making a PR to fix this?

thanks @jcadam14 and congrats on your first PR to pandera! 🚀

@marrov please feel free to make a PR for this!

thanks @marrov ! please run pre-commit to fix linter errors: https://pandera.readthedocs.io/en/stable/CONTRIBUTING.html#set-up-pre-commit

thanks @marrov ! sorry to extend this a little longer, but this check needs unit tests, which can live here: https://github.com/unionai-oss/pandera/blob/main/tests/pyspark/test_pyspark_check.py

thanks @AlpAribal do you mind rebasing these changes onto the `main` branch? failing tests should go away aftaer that

linter is making some valid complaints: ``` ************* Module pandera.engines.pandas_engine pandera/engines/pandas_engine.py:1320:26: E1101: Instance of 'Field' has no 'model_validate' member (no-member) pandera/engines/pandas_engine.py:13[22](https://github.com/unionai-oss/pandera/actions/runs/9628170517/job/26571671455?pr=1696#step:10:23):26: E1101: Instance of 'Field' has no 'parse_obj' member (no-member)...

@AlpAribal I'm okay with ignoring the pylint warning