botocore icon indicating copy to clipboard operation
botocore copied to clipboard

Boto3 Performance degradation after ugprade from python 3.8 to 3.12

Open jricardooliveira opened this issue 7 months ago • 4 comments

Describe the bug

We have been experiencing significant performance degradation in our services after upgrading our environment from Python 3.8 with boto3 1.28 (container running python:3.8.16-slim-buster) to Python 3.12 with any version of boto3 greater than or equal to 1.28 (container running python:3.12.2-slim-bookworm).

Expected Behavior

The performance should be consistent across requests, similar to the behavior observed in the Python 3.8 environment.

Current Behavior

Screenshot 2024-07-19 at 10 12 01

Reproduction Steps

1- Set up a container with Python 3.8.16-slim-buster and boto3 1.28. 2 - Set up a container with Python 3.12.2-slim-bookworm and boto3 1.28 or higher. 3 - Send multiple burst requests from a single user to a service using boto3.

In the screenshot you may see the performance degradation before and after and the culprit... boto3 kinesis POST request. Screenshot 2024-07-19 at 10 07 31

Possible Solution

No response

Additional Information/Context

We suspect that the connection initialization process in the newer environment might be causing this issue. Any insights or suggestions on how to address this performance degradation would be greatly appreciated.

SDK version used

1.28.x 1.34.x

Environment details (OS name and version, etc.)

Container Debian slim-bookworm

jricardooliveira avatar Jul 19 '24 09:07 jricardooliveira