DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

Reverse replication overrides support

Open Deep1998 opened this issue 6 months ago • 1 comments

Reverse replication overrides

  • Support Source ddls
  • Refactor to not use session file for anytohing other than schema mapping/use sourceddl for type info
  • Swap sessino based mapper with schemamapper
  • add overrides support

Deep1998 avatar Jun 22 '25 21:06 Deep1998

Codecov Report

Attention: Patch coverage is 76.49573% with 110 lines in your changes missing coverage. Please review.

Project coverage is 49.73%. Comparing base (1c0eb5c) to head (086bc8d).

Files with missing lines Patch % Lines
...cloud/teleport/v2/templates/SpannerToSourceDb.java 0.00% 56 Missing :warning:
...eport/v2/spanner/migrations/utils/SchemaUtils.java 88.34% 6 Missing and 6 partials :warning:
...ates/dbutils/processor/SourceProcessorFactory.java 0.00% 11 Missing :warning:
...2/templates/dbutils/dml/CassandraDMLGenerator.java 88.13% 2 Missing and 5 partials :warning:
...anner/sourceddl/MySqlInformationSchemaScanner.java 86.48% 2 Missing and 3 partials :warning:
...r/sourceddl/CassandraInformationSchemaScanner.java 92.15% 2 Missing and 2 partials :warning:
...eport/v2/templates/transforms/AssignShardIdFn.java 69.23% 3 Missing and 1 partial :warning:
...rt/v2/templates/dbutils/dml/MySQLDMLGenerator.java 94.11% 0 Missing and 3 partials :warning:
...eleport/v2/templates/utils/ShardIdFetcherImpl.java 66.66% 2 Missing and 1 partial :warning:
.../spanner/migrations/schema/SessionBasedMapper.java 50.00% 2 Missing :warning:
... and 2 more
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2478      +/-   ##
============================================
+ Coverage     49.62%   49.73%   +0.11%     
- Complexity     4813     5162     +349     
============================================
  Files           942      949       +7     
  Lines         57751    58034     +283     
  Branches       6241     6281      +40     
============================================
+ Hits          28658    28865     +207     
- Misses        27049    27115      +66     
- Partials       2044     2054      +10     
Components Coverage Δ
spanner-templates 69.98% <76.49%> (+0.04%) :arrow_up:
spanner-import-export 68.62% <ø> (-0.02%) :arrow_down:
spanner-live-forward-migration 79.36% <90.94%> (+0.57%) :arrow_up:
spanner-live-reverse-replication 77.09% <76.49%> (-0.19%) :arrow_down:
spanner-bulk-migration 87.97% <90.94%> (+0.07%) :arrow_up:
Files with missing lines Coverage Δ
...m/google/cloud/teleport/v2/spanner/ddl/Column.java 58.57% <100.00%> (+0.24%) :arrow_up:
.../teleport/v2/spanner/migrations/schema/Schema.java 90.47% <100.00%> (+0.31%) :arrow_up:
...rceddl/AbstractSourceInformationSchemaScanner.java 100.00% <100.00%> (ø)
...ud/teleport/v2/spanner/sourceddl/SourceColumn.java 100.00% <100.00%> (ø)
...eport/v2/spanner/sourceddl/SourceDatabaseType.java 100.00% <100.00%> (ø)
...ud/teleport/v2/spanner/sourceddl/SourceSchema.java 100.00% <100.00%> (ø)
...oud/teleport/v2/spanner/sourceddl/SourceTable.java 100.00% <100.00%> (ø)
...plates/dbutils/processor/InputRecordProcessor.java 86.44% <100.00%> (-1.28%) :arrow_down:
...leport/v2/templates/transforms/SourceWriterFn.java 85.34% <100.00%> (+0.12%) :arrow_up:
...t/v2/templates/utils/ShardingLogicImplFetcher.java 58.69% <100.00%> (ø)
... and 12 more

... and 2 files with indirect coverage changes

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov[bot] avatar Jul 02 '25 08:07 codecov[bot]