aws-serverless-data-lake-framework icon indicating copy to clipboard operation
aws-serverless-data-lake-framework copied to clipboard

Published 20 hours ago • verified publisher icon awslabs

Datasets Dependency Management Tutorial Does Not Work

Open bencaldwell opened this issue 2 years ago • 1 comments

Describe the bug I am trying to follow the tutorial for dataset dependencies at https://github.com/awslabs/aws-serverless-data-lake-framework/blob/master/sdlf-utils/pipeline-examples/dataset-dependency/README.md I can not make this work. Perhaps there is a step missing from the readme?

To Reproduce Steps to reproduce the behavior:

  1. Provision the datalake as per the SDLF workshop
  2. Deploy the pipeline from stageA directory using sam build; sam deploy --guided --capabilities CAPABILITY_NAMED_IAM
  3. Deploy the dataset from dataset directory using sam build; sam deploy --guided --capabilities CAPABILITY_NAMED_IAM
  4. See error Pipeline doesn't exist or inactive

Expected behavior I expected to see an entry for the new dataset in dynamoDB table octagon-Datasets-dev after running the above. Then I could update dependencies as per the tutorial and see the step function succeed.

bencaldwell avatar Aug 01 '22 14:08 bencaldwell

I'm fixing this one.

mariandumitrascu avatar Feb 20 '23 16:02 mariandumitrascu