data-prep-kit icon indicating copy to clipboard operation
data-prep-kit copied to clipboard

Add Super pipeline for code transforms.

Open revit13 opened this issue 1 year ago • 2 comments
trafficstars

Why are these changes needed?

This PR implements a pipeline for the notebook

ingest 2 parquet phase is not part of the super pipeline. its output was manually generated by running the notebook phase.

Please note that transforms images are not synced with the latest code in the repo. To run the pipelines please do: cd transforms && make image && load-image to upload the latest versions to kind cluster.

Related issue number (if any).

revit13 avatar May 23 '24 05:05 revit13

@revit13 , we'll need a document that explains it

roytman avatar May 23 '24 05:05 roytman

@revit13 , we'll need a document that explains it

@roytman I added description to kfp/doc/multi_transform_pipeline.md.

revit13 avatar May 27 '24 14:05 revit13