kedro-pandera icon indicating copy to clipboard operation
kedro-pandera copied to clipboard

Feature/allow converting

Open mjspier opened this issue 9 months ago • 4 comments

Description

Allow converting input data according to the pandera schema so data types only need to be define in the schema and not also als load parameter.

Development notes

  • Added reading of global and dataset parameter (convert)
  • Added to return validated dataset when parameter is set
  • Enabled validation + conversion also for output datasets
  • Added unittest to test conversion example

Checklist

  • [ ] Read the contributing guidelines
  • [ ] Open this PR as a 'Draft Pull Request' if it is work-in-progress
  • [ ] Update the documentation to reflect the code changes
  • [ ] Add a description of this change and add your name to the list of supporting contributions in the CHANGELOG.md file. Please respect Keep a Changelog guidelines.
  • [ ] Add tests to cover your changes

Notice

  • [ ] I acknowledge and agree that, by checking this box and clicking "Submit Pull Request":

  • I submit this contribution under the Apache 2.0 license and represent that I am entitled to do so on behalf of myself, my employer, or relevant third parties, as applicable.

  • I certify that (a) this contribution is my original creation and / or (b) to the extent it is not my original creation, I am authorised to submit this contribution on behalf of the original creator(s) or their licensees.

  • I certify that the use of this contribution as authorised by the Apache 2.0 license does not violate the intellectual property rights of anyone else.

mjspier avatar May 10 '24 08:05 mjspier