cdp-backend icon indicating copy to clipboard operation
cdp-backend copied to clipboard

Make event gather pipeline dry-runnable

Open evamaxfield opened this issue 3 years ago • 0 comments

Feature Description

A clear and concise description of the feature you're requesting.

Add a parameter to the pipeline that enables us to dryrun it without any database or file store upload.

Use Case

Please provide a use case to help us understand your request in context.

Would be very useful to dryrun the pipeline during deployment bot configuration validation.

Solution

Please describe your ideal solution.

  • wait for #57 to allow passing a single event or multiple events to the pipeline directly
  • if the event doesnt come with captions, mock the transcript generation interaction
  • mock all file store and database upload interactions
  • add a task to the pipeline that runs if it was a dry run that stores the created database models to a single json file. (this should be possible because fireo has a to_dict method on all model objects.)

Alternatives

Please describe any alternatives you've considered, even if you've dismissed them.

evamaxfield avatar Aug 15 '21 08:08 evamaxfield