HCD-481 : Adding reconnection logic added for HDFS2 sink connector

[SanchayGupta1197]

trafficstars

Problem

The connector was failing for Avro and ORC format when the connection to the cluster was interrupted.

Solution

Fix for Avro

• The schema was re-initialized to null in order to invalidate the current temp file.
• The AvroRuntimeException was caught and thrown as a ConnectException.

Fix for ORC

• The schema was re-initialized to null in order to invalidate the current temp file.
• The AlreadyBeingCreatedException was handled by deleting the temp file from the cluster.

Test Strategy

Testing done:

• [ ] Unit tests
• [ ] Integration tests
• [ ] System tests
• [x] Manual tests

Issues/Limitation

• Integration test not feasible due to dependency conflicts between connect-runtime and HDFS minicluster.

[ghost]

It looks like @SanchayGupta1197 hasn't signed our Contributor License Agreement, yet.

The purpose of a CLA is to ensure that the guardian of a project's outputs has the necessary ownership or grants of rights over all contributions to allow them to distribute under the chosen licence. Wikipedia

You can read and sign our full Contributor License Agreement here.

Once you've signed reply with [clabot:check] to prove it.

Appreciation of efforts,

clabot

[cla-assistant[bot]]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 2 committers have signed the CLA.

:x: sagar-ab-2702
:x: SanchayGupta1197
_{You have signed the CLA already but the status is still pending? Let us recheck it.}