data-prep-kit
data-prep-kit copied to clipboard
Add Super pipeline for code transforms.
trafficstars
Why are these changes needed?
This PR implements a pipeline for the notebook
ingest 2 parquet phase is not part of the super pipeline. its output was manually generated by running the notebook phase.
Please note that transforms images are not synced with the latest code in the repo. To run the pipelines please do:
cd transforms && make image && load-image to upload the latest versions to kind cluster.
Related issue number (if any).
@revit13 , we'll need a document that explains it
@revit13 , we'll need a document that explains it
@roytman I added description to kfp/doc/multi_transform_pipeline.md.