[BUG]Issue with com.azure.core.amqp.exception.AmqpException: FAIL_NON_SERIALIZED occurred.

[mahajanpranit111]

Describe the bug We encountered an error while using the Azure SDK for Java, specifically with the Event Hubs Buffered Partition Producer. The error message received is as follows:

EventHubBufferedPartitionProducer - {"az.sdk.message":"Event could not be published downstream. Applying retry.","partitionId":"2","emitResult":"FAIL_NON_SERIALIZED"} 
.
.
.
Caused by: com.azure.core.amqp.exception.AmqpException: FAIL_NON_SERIALIZED occurred., errorContext[NAMESPACE: {our AEH namespace}. ERROR CONTEXT: N/A]
at com.azure.messaging.eventhubs.EventHubBufferedPartitionProducer.lambda$enqueueEvent$0(EventHubBufferedPartitionProducer.java:140)

To Reproduce Cannot reproduce on demand, it's intermittent issue. Ran load tests as well but could not reproduce.

Expected behavior We expected the Event Hubs Buffered Partition Producer to enqueue events without encountering the "FAIL_NON_SERIALIZED" error.

Setup (please complete the following information):

• Library/Libraries: azure-messaging-eventhubs:5.18.1
• Java version: 17
• Frameworks: Spring Boot

Additional context We are generating/enqueuing events around 5k/min, out of that around 200/min were failed. NOTE: This is intermittent issue.

Information Checklist Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

• [x] Bug Description Added
• [x] Repro Steps Added
• [x] Setup information Added

[github-actions[bot]]

@anuchandy @conniey @lmolkova

[github-actions[bot]]

Thank you for your feedback. Tagging and routing to the team member best able to assist.

[lmolkova]

@mahajanpranit111 thanks for reporting this!

We'll check if it's related to the SDK logic or to a transient network issue and might come back with more questions.

Did you observe any functional issue associated with it? The log indicates that it's a transient issue that will be retried - do you know if it was actually retried or do you see any indications that events were not published?

[mahajanpranit111]

@lmolkova Thanks for the response. Yes, it retried and after that retries exhausted. And events were not published to AEH. Error occurred while adding batch: [Retries exhausted., errorContext[NAMESPACE: {our NS} ERROR CONTEXT: N/A]] | com.azure.core.amqp.exception.AmqpException: Retries exhausted., errorContext[NAMESPACE: {our NS}. ERROR CONTEXT: N/A] .... ..... Caused by: com.azure.core.amqp.exception.AmqpException: FAIL_NON_SERIALIZED occurred

[anuchandy]

Hi Mahajan, since we’re syncing on this offline, I would close this so we can avoid duplicating effort.