pandera icon indicating copy to clipboard operation
pandera copied to clipboard

Support polars DataFrames, LazyFrames

Open cosmicBboy opened this issue 1 year ago • 1 comments

Base PR for polars development work

The polars-dev branch is where development work to add polars support in pandera. The scope of this support is to cover the core pandera API:

  • core schemas
  • schema components
  • built-in and custom checks
  • integration with pandera type system
  • dataframe models
  • function decorators
  • configuration for enabling/disabling validation

See here for a more complete picture of the components above, and here for higher-level pieces of work that can be tackled somewhat independently.

Future work will cover the extras functionality such as serialization/deserialization of schemas to yaml/json or data synthesis strategies (unless there are some eager contributors out there who want to run with it).

cosmicBboy avatar Oct 07 '23 04:10 cosmicBboy

Codecov Report

Attention: Patch coverage is 0.73260% with 271 lines in your changes are missing coverage. Please review.

Project coverage is 90.71%. Comparing base (4df61da) to head (cc9cb6f). Report is 21 commits behind head on main.

:exclamation: Current head cc9cb6f differs from pull request most recent head d25586c. Consider uploading reports for the commit d25586c to get more accurate results

Files Patch % Lines
pandera/backends/polars/builtin_checks.py 0.00% 58 Missing :warning:
pandera/backends/polars/components.py 0.00% 49 Missing :warning:
pandera/backends/polars/base.py 0.00% 45 Missing :warning:
pandera/backends/polars/checks.py 0.00% 39 Missing :warning:
pandera/backends/polars/container.py 0.00% 39 Missing :warning:
pandera/backends/polars/__init__.py 0.00% 11 Missing :warning:
pandera/api/polars/types.py 0.00% 10 Missing :warning:
pandera/api/polars/components.py 0.00% 8 Missing :warning:
pandera/api/polars/container.py 0.00% 6 Missing :warning:
pandera/polars.py 0.00% 4 Missing :warning:
... and 1 more
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1373      +/-   ##
==========================================
- Coverage   94.29%   90.71%   -3.58%     
==========================================
  Files          91      102      +11     
  Lines        7024     7246     +222     
==========================================
- Hits         6623     6573      -50     
- Misses        401      673     +272     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov[bot] avatar Oct 07 '23 04:10 codecov[bot]