ozone icon indicating copy to clipboard operation
ozone copied to clipboard

HDDS-11409. Bump pipeline and client cache configuration defaults

Open tanvipenumudy opened this issue 1 year ago • 0 comments

What changes were proposed in this pull request?

Pipeline Configuration Defaults:

  • ozone.scm.datanode.pipeline.limit to 12 (default: 2)
  • ozone.scm.ec.pipeline.minimum to 20 (default: 5)

The pipeline counts are restricted to a set limit per Datanode. Until we have HDDS-10710 automated, one needs to tune these configurations for achieving peak read and write performance. Users may dial down these settings for smaller clusters as needed.

Client Connection Cache Configuration Default:

  • scm.container.client.max.size to 4096 (default: 256)

Bumping this property increases the memory footprint of client applications using the Ozone FS jar. Therefore, setting this default high enough is a good option. Users may bump this value higher if required.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-11409

How was this patch tested?

Existing unit and integration tests should cover the changes (no functional change).

tanvipenumudy avatar Sep 03 '24 18:09 tanvipenumudy