Niels Bantilan

Hey @rbeucher thanks! I'm currently doing a major overhaul of pandera's internals, which should make adding new features like this easier: https://github.com/unionai-oss/pandera/issues/381 You can check out progress on this branch:...

this was fixed by https://github.com/unionai-oss/pandera/pull/989

fixed by #859

@anantzoid current status is `help wanted`. Open to contribution! Basically would require: - creating new pandera datatypes (see [here](https://pandera.readthedocs.io/en/stable/dtypes.html)) that supports: - lists: `list`, `List[...]` - dictionaries: `dict`, `Dict[...]` -...

Note: based on [this thread](https://discord.com/channels/897120336003334214/897554078274555965/1038023505075245078) we also want the pandera datatype system to handle unhashable types (sets, lists)

@pingsutw is already working on this https://github.com/flyteorg/flytesnacks/pull/735 This issue is to document how to create your own renderer, probably somewhere [here](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/extend_flyte/index.html)

@bmwilly if there's additional context/steps here to reproduce (e.g. environment setup steps, a toy example of the workflow you're trying to run) we'd appreciate it!

hey @sugatoray thanks for the work on this and apologies for being late on the feedback here: > 1. The number of plugins would most likely grow in future. Currently...

great! let's go with your proposal, it's true that flytekit plugins will only continue to grow

you could also pipe schemas :) ```python import pandera as pa schema = pa.DataFrameSchema({ "A": pa.Column(checks=pa.Check(lambda A: A.sum() == 0)), "B": pa.Column(...), ... # etc }) ( df .then(schema) #...