Nestor10
Nestor10
Running into a similar issue; sporadic - rare - dups. Some key differences, db runtime 8.2 (delta 0.8.0), source for merge is another delta table not jdbc. I'm in the...
Tried to reproduce this in a unit test. This is a hard one. I ran into https://github.com/delta-io/delta/issues/630 so i had to bump to delta 1.0.0. (It this still super secret?)....
One last note. I'm a databricks customer, I can provide a information via DM to start a conversation. I have a DB instance where this happens frequently and there may...
@chrishfish Not sure if a CASE NUMBER # 00103912 would be helpful to you but here it is. Mathan is working it, if that has meaning. If you have the...
@tdas Thanks for the attention to this issue! I was able to identify a non-deterministic behavior in my data. Current_timestamp, yep, that'll do it and so, I fall clearly onto...
changed report name from coverage-report.xml to cov.xml and it fixed my issue.
Still needed or wanted? When i first looked at this I wasn't sure if schema was persevered when casting a df to a ds. But it is ``` scala val...
https://github.com/Nestor10/spark-fast-tests/commit/1b767723e07052cb3419af3d046400996c8e32f3 A demo with working test. There are some weird things with encoders here, requiring us to be a little sneaky with datasets. But it works; all new and old...
I have a working solution but i would like feed back before I write the remaining unit tests. Dataframe but not Dataset coverage. Additionally, for the dataset coverage I may...