DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

[Bug]: Compilation Error with MongoDB to BigQuery

Open wazi55 opened this issue 1 year ago • 1 comments

Related Template(s)

MongoDbToBigQuery & MongoDbToBigQueryCDC

Template Version

Don't know

What happened?

While trying to make a contribution to allow mongodb to bigquery to support Json in a USER_OPTION=FLATTEN, I cannot seem to compile the code successfuly

To reproduce:

export PROJECT="project"
export BUCKET_NAME="bucket"

mvn clean package -PtemplatesStage  \
-DskipTests \
-DprojectId="$PROJECT" \
-DbucketName="$BUCKET_NAME" \
-DstagePrefix="templates" \
-DtemplateName="MongoDB_to_BigQuery" \
-f v2/mongodb-to-googlecloud

Relevant log output

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.11.0:compile (default-compile) on project mongodb-to-googlecloud: Compilation failure
[ERROR] /Users/wazi/Downloads/DataflowTemplates/v2/mongodb-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/mongodb/options/MongoDbToBigQueryOptions.java:[136,23] cannot find symbol
[ERROR]   symbol:   class JavascriptUdfFile
[ERROR]   location: class com.google.cloud.teleport.metadata.TemplateParameter
[ERROR] 
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

wazi55 avatar Aug 15 '24 10:08 wazi55

It does seem like the JavascriptUdfFile interface is in the right file DataflowTemplates/metadata/src/main/java/com/google/cloud/teleport/metadata/TemplateParameter.java

wazi55 avatar Aug 15 '24 10:08 wazi55

This issue has been marked as stale due to 180 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the issue at any time. Thank you for your contributions.

github-actions[bot] avatar Feb 12 '25 02:02 github-actions[bot]

This issue has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

github-actions[bot] avatar Feb 19 '25 02:02 github-actions[bot]