OpenSearch icon indicating copy to clipboard operation
OpenSearch copied to clipboard

[Remote Store] Update AWS SDK version to fix connection acquisition timeout issues

Open shourya035 opened this issue 1 year ago • 2 comments

Describe the bug

We are seeing timeouts in connection acquisition from S3 client thread pool since we are hitting this AWS SDK bug: https://github.com/aws/aws-sdk-java-v2/pull/4066 . This is causing issues with remote uploads when AWS S3 has been setup as the remote store.

The fix has been released with AWS SDK 2.20.86 and above. We would need to update our AWS SDK dependency

Related component

Storage

To Reproduce

N/A

Expected behavior

There shouldn't be any leaking connections

Additional Details

Plugins Please list all plugins currently enabled.

Screenshots If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

  • OS: [e.g. iOS]
  • Version [e.g. 22]

Additional context Add any other context about the problem here.

shourya035 avatar Jan 24 '24 06:01 shourya035

[Triage - attendees 1 2 3] @shourya035 Thanks for noting this, we've gladly welcome a PR that updates the AWS SDK version.

peternied avatar Jan 24 '24 16:01 peternied

@shourya035 can we raise a PR for this?

linuxpi avatar Feb 06 '24 06:02 linuxpi

This needs to be fixed for 2.13

rramachand21 avatar Mar 07 '24 16:03 rramachand21

[Storage Triage - attendees 1 2 3 4 5 6 7 8 9 10 11 12]

@shourya035 lets link the PR and close this issue.

linuxpi avatar May 02 '24 15:05 linuxpi

Closing this since the AWS SDK version was updated through: https://github.com/opensearch-project/OpenSearch/pull/12251

shourya035 avatar May 02 '24 15:05 shourya035