cdp-backend
cdp-backend copied to clipboard
Make event gather pipeline dry-runnable
Feature Description
A clear and concise description of the feature you're requesting.
Add a parameter to the pipeline that enables us to dryrun it without any database or file store upload.
Use Case
Please provide a use case to help us understand your request in context.
Would be very useful to dryrun the pipeline during deployment bot configuration validation.
Solution
Please describe your ideal solution.
- wait for #57 to allow passing a single event or multiple events to the pipeline directly
- if the event doesnt come with captions, mock the transcript generation interaction
- mock all file store and database upload interactions
- add a task to the pipeline that runs if it was a dry run that stores the created database models to a single json file. (this should be possible because
fireo
has ato_dict
method on all model objects.)
Alternatives
Please describe any alternatives you've considered, even if you've dismissed them.