mack icon indicating copy to clipboard operation
mack copied to clipboard

Published 20 hours ago • verified publisher icon MrPowers

Feature/dlq

Open souvik-databricks opened this issue 2 years ago • 4 comments

Work for #53 going on this branch and will be addressed as part of this PR CC: @robertkossendey

souvik-databricks avatar Dec 31 '22 16:12 souvik-databricks

@robertkossendey I will be adding the ability to write the invalid records to a separate DLQ table but I need help for this two

  • Ability to automatically mark rows as invalid in target table
  • Ability to fail on invalid records

Please feel free to jump in on this branch and add in your logic for that functionality

souvik-databricks avatar Dec 31 '22 17:12 souvik-databricks

@souvik-databricks sure, will do! could you provide an example for each method to show how it is supposed to be used?

robertkossendey avatar Dec 31 '22 18:12 robertkossendey

@souvik-databricks - can you add some tests for these WIP functions? Think that'll make it easier for me to see what functionality you're going for here. Thanks!

MrPowers avatar Jan 10 '23 14:01 MrPowers

@MrPowers I think we can close this PR now, right?

robertkossendey avatar Mar 11 '23 22:03 robertkossendey