Easy end-to-end testing framework for pipeline authors that can be integrate to their CI

[vigith]

Summary

Numaflow pipeline authors should be able to test the end-to-end pipeline spec and validate the outputs from the Sink based on the data they sent to the Source. The testing framework should be easily integrated into their CI and/or local development platform.

Use Cases

• End-to-end testing in CI
• Validation in local setup

---

Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.

[KeranYang]

A good reference: https://github.com/numaproj-contrib/aws-sqs-sink-go/blob/main/.github/workflows/ci.yaml

In some of our udsource and udsink repositories, we have a CI workflow that builds the image, stores it locally in a /tmp/ folder in the CI workflow runner and uses it to e2e test.