[Bug]: mongodb cdc to Bigquery is not reading data from mongoDB and publish to pubsub

[rammanokar-plateron]

Related Template(s)

MongoDB_to_BigQuery_CDC

Template Version

latest

What happened?

Here's a rewritten version of your text in a format suitable for a GitHub issue:

Issue: MongoDB_to_BigQuery_CDC template not accessing MongoDB

Description:

According to the template documentation, we need to provide input as MongoDB URI, database, and collection name. However, the MongoDB_to_BigQuery_CDC template is not accessing MongoDB at all.

When testing, nothing is populated in the given Pub/Sub topic. Instead, we need to manually push the changestream to Pub/Sub, which defeats the purpose of providing MongoDB details for this template.

Expected behavior: The template should access MongoDB using the provided URI, database, and collection name, and populate the Pub/Sub topic accordingly.

Steps to reproduce:

1. Provide MongoDB URI, database, and collection name as input to the MongoDB_to_BigQuery_CDC template.
2. Test the template.
3. Observe that nothing is populated in the given Pub/Sub topic.

Note: We should not need to manually push the changestream to Pub/Sub. The template should handle this automatically.

Relevant log output

Not applicable