step missing in "Manifest based processing." pipeline example

[mariandumitrascu]

I was going through the "manifest" pipeline example (in ./sdlf-utils/pipeline-examples/manifests), and I noticed, one step is mission from installation instructions: - that is about the pipeline project, which is in this case "sdlf-engineerng-manifest-pipeline". It doest get deployed but it should. This repo is responsible for deploying the step functions for stage A and stage B for the manifest example.

To replicate this observation, install SDLF on an pristine account and go through all steps in the workshop from https://catalog.us-east-1.prod.workshops.aws/workshops/501cb14c-91b3-455c-a2a9-d0a21ce68114/en-US/10-deployment/100-setup Then follow the steps from https://github.com/awslabs/aws-serverless-data-lake-framework/blob/master/sdlf-utils/pipeline-examples/manifests/README.md , to install "manifest" example. You will notice that in none of the steps, the step-functions gets deployed.

To fix this issue, I see at least two options: - execute ./deploy.sh in ./sdlf-engineering-manifest-pipeline from local machine. This is what I did to get the example working. - second option - the right one - is to generate a code-pipeline pipeline for sdlf-engineering-manifest-pipeline project in the same way that a pipeline was created for sdlf-engineering-pipeline project in the workshop.

I would assign this issue to me make a pull request for this, if permitted.

Thank you, -Marian