DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

Mongo to BigQuery - set schema manually in case js udf is filtering data

Open stankiewicz opened this issue 1 year ago • 1 comments

MongoDB to JDBC has an issue with schema detection when UDF is used for filtering - #1328 .

Good workaround is providing schema directly, similarly to JDBC, Oracle to BigQuery.

stankiewicz avatar Apr 29 '24 11:04 stankiewicz

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 40.33%. Comparing base (f14c62c) to head (795c58c). Report is 90 commits behind head on main.

:exclamation: Current head 795c58c differs from pull request most recent head 81c4dcc

Please upload reports for the commit 81c4dcc to get more accurate results.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #1484      +/-   ##
============================================
- Coverage     41.29%   40.33%   -0.96%     
+ Complexity     2929     2730     -199     
============================================
  Files           769      727      -42     
  Lines         44602    41531    -3071     
  Branches       4770     4466     -304     
============================================
- Hits          18418    16752    -1666     
+ Misses        24636    23319    -1317     
+ Partials       1548     1460      -88     
Components Coverage Δ
spanner-templates 55.72% <ø> (-5.69%) :arrow_down:
spanner-import-export 65.61% <ø> (+1.16%) :arrow_up:
spanner-live-forward-migration 61.19% <ø> (-12.68%) :arrow_down:
spanner-live-reverse-replication 42.50% <ø> (-7.21%) :arrow_down:
spanner-bulk-migration 69.42% <ø> (-12.64%) :arrow_down:

see 256 files with indirect coverage changes

codecov[bot] avatar Apr 29 '24 11:04 codecov[bot]

Would you mind rebase your PR onto the latest main branch? The internal import has conflicts

Abacn avatar Jul 03 '24 17:07 Abacn