Sonu Singh

Yes. the ID column is sequence Primary Key in oracle and hence it cannot have duplicates. I also validated that by looking at the ID's that were duplicates in source...

We have looked at this and as we are ingesting from Oracle, we run a single Spark application from a single driver and the data gets inserted or updated from...

Any idea on the issue?

Yeah...its the same issue with us. We cannot reproduce this issue. It gets randomly created. I assume this is a bug in Delta, but have not received any guidance on...

@arnehuang I am not sure if merging different table would cause an issue. Also, we run one job per application and still we are getting this bug. So I assume...

@zsxwing Yes, we use Oracle JDBC to connect and oracle doesnot have a duplicate record, the primary key is unique and auto increment, so the `new_df` should have the correct...

I don’t think so. I have been trying to get response on this and no one from Delta Team has been responding or trying to help. Thanks On Sun, Mar...

Sure. I can try to help in reproducing the issue. What help do you need from me ? Thanks On Mon, Mar 15, 2021 at 5:58 PM scanry ***@***.***> wrote:...

I don’t think I am able to reproduce the issue and that’s the main problem. This issue happens sporadically and we don’t the reason why. Let me know how I...

@Nestor10 thanks a lot for the defect. Hopefully this helps to get to the root of the problem. Please do keep us posted if you get any concrete update on...