openshift-docs icon indicating copy to clipboard operation
openshift-docs copied to clipboard

OSDOCS-8015: Adding a total resource usage table

Open mpandya15 opened this issue 1 year ago • 17 comments

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview: https://77127--ocpdocs-pr.netlify.app/openshift-enterprise/latest/observability/network_observability/configuring-operator.html

QE review:

  • [ ] QE has approved this change.

Additional information: Table mockup: https://docs.google.com/document/d/1xyBeIehZwyV_p7GkP9uJbr1ay5vFFcWsZwi3SENtB70/edit?usp=sharing

mpandya15 avatar Jun 06 '24 18:06 mpandya15

@mpandya15: This pull request references OSDOCS-10726 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#10726]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-10726

Link to docs preview:

QE review:

  • [ ] QE has approved this change.

Additional information:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 06 '24 18:06 openshift-ci-robot

🤖 Mon Jul 22 20:20:29 - Prow CI generated the docs preview:

https://77127--ocpdocs-pr.netlify.app/openshift-enterprise/latest/observability/network_observability/configuring-operator.html

ocpdocs-previewbot avatar Jun 06 '24 18:06 ocpdocs-previewbot

/retest

JoeAldinger avatar Jun 07 '24 12:06 JoeAldinger

@mpandya15: This pull request references OSDOCS-10726 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#10726]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview:

QE review:

  • [ ] QE has approved this change.

Additional information:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 12 '24 14:06 openshift-ci-robot

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#10726]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview:

QE review:

  • [ ] QE has approved this change.

Additional information:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 12 '24 17:06 openshift-ci-robot

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview:

QE review:

  • [ ] QE has approved this change.

Additional information:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 12 '24 17:06 openshift-ci-robot

Hi @mpandya15 @skrthomas FYI here's more recommendations after running fine-tuning tests: https://issues.redhat.com/browse/NETOBSERV-1702?focusedId=24983810&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-24983810

10-nodes cluster: cacheMaxSize = 50000, Kafka consumer replicas: N/A 25-nodes cluster: cacheMaxSize = 100000 (default), Kafka consumer replicas: 6 65-nodes cluster: cacheMaxSize = 100000 (default), Kafka consumer replicas: 12 120-nodes cluster: cacheMaxSize = 100000 (default), Kafka consumer replicas: 18

cc @memodi

jotak avatar Jun 24 '24 09:06 jotak

10-nodes cluster: set cacheMaxSize to 50000 25-nodes cluster: use 6 FLP replicas 65-nodes cluster: use 12 FLP replicas 120-nodes cluster: use 18 FLP replicas

cc @stleerh thanks @jotak. Any reason why we'd recommend cacheMaxSize to 50K? I thought you mentioned no noticeable improvements were observed altering the cacheMaxSIze.

memodi avatar Jun 24 '24 16:06 memodi

@memodi it's extrapolated from my 6-nodes cluster, using my own tests (where fine-tuning leads me to 10K size). I don't think we have a test procedure for 10 nodes, do we?

jotak avatar Jun 24 '24 16:06 jotak

I don't think we have a test procedure for 10 nodes, do we?

that's right, we don't. I am thinking several of our customers could fall into this category where they could have several smaller clusters < 10 nodes and based on these recommendation it would mean they'd have to change from default cacheMaxSize to 50k in flowcollector, is that something we want?

memodi avatar Jun 24 '24 16:06 memodi

@memodi they don't have to, this is only recommendations, and ideally they should do their own tuning. But they can definitely start with that. cf https://netobserv.io/documents/blogs/agent_metrics_perf/

jotak avatar Jun 25 '24 06:06 jotak

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview:

QE review:

  • [ ] QE has approved this change.

Additional information: Table mockup: https://docs.google.com/document/d/1xyBeIehZwyV_p7GkP9uJbr1ay5vFFcWsZwi3SENtB70/edit?usp=sharing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 25 '24 15:06 openshift-ci-robot

Hi @mpandya15 @skrthomas FYI here's more recommendations after running fine-tuning tests: https://issues.redhat.com/browse/NETOBSERV-1702?focusedId=24983810&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-24983810

10-nodes cluster: set cacheMaxSize to 50000 25-nodes cluster: use 6 FLP replicas 65-nodes cluster: use 12 FLP replicas 120-nodes cluster: use 18 FLP replicas

cc @memodi

Hi Joel, thanks for bringing this up. We plan to include the cacheMaxFlows updates in a separate PR to update the existing info in the resource recommendations table.

mpandya15 avatar Jun 25 '24 20:06 mpandya15

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview:

QE review:

  • [ ] QE has approved this change.

Additional information: Table mockup: https://docs.google.com/document/d/1xyBeIehZwyV_p7GkP9uJbr1ay5vFFcWsZwi3SENtB70/edit?usp=sharing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 25 '24 20:06 openshift-ci-robot

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview: https://77127--ocpdocs-pr.netlify.app/openshift-enterprise/latest/observability/network_observability/configuring-operator.html

QE review:

  • [ ] QE has approved this change.

Additional information: Table mockup: https://docs.google.com/document/d/1xyBeIehZwyV_p7GkP9uJbr1ay5vFFcWsZwi3SENtB70/edit?usp=sharing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jun 25 '24 20:06 openshift-ci-robot

Hey @memodi @skrthomas @jotak @stleerh, I've addressed your feedback and made the required changes. PTAL at my latest updates and let me know if there's other changes. Thank you! 😊

mpandya15 avatar Jul 01 '24 19:07 mpandya15

thanks @mpandya15

/label qe-approved

memodi avatar Jul 18 '24 16:07 memodi

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview: https://77127--ocpdocs-pr.netlify.app/openshift-enterprise/latest/observability/network_observability/configuring-operator.html

QE review:

  • [ ] QE has approved this change.

Additional information: Table mockup: https://docs.google.com/document/d/1xyBeIehZwyV_p7GkP9uJbr1ay5vFFcWsZwi3SENtB70/edit?usp=sharing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 18 '24 16:07 openshift-ci-robot

/label peer-review-needed

mpandya15 avatar Jul 18 '24 17:07 mpandya15

@mpandya15: This pull request references OSDOCS-8015 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

[OSDOCS#8015]: Adding a total resource usage table

Version(s):

Issue: https://issues.redhat.com/browse/OSDOCS-8015

Link to docs preview: https://77127--ocpdocs-pr.netlify.app/openshift-enterprise/latest/observability/network_observability/configuring-operator.html

QE review:

  • [x] QE has approved this change.

Additional information: Table mockup: https://docs.google.com/document/d/1xyBeIehZwyV_p7GkP9uJbr1ay5vFFcWsZwi3SENtB70/edit?usp=sharing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jul 18 '24 17:07 openshift-ci-robot

Hello @mpandya15, Just a couple of comments/suggestions, otherwise LGTM. Good job! Thanks.

mletalie avatar Jul 22 '24 13:07 mletalie

New changes are detected. LGTM label has been removed.

openshift-ci[bot] avatar Jul 22 '24 19:07 openshift-ci[bot]

/label merge-review-needed

mpandya15 avatar Jul 22 '24 19:07 mpandya15

@mpandya15: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Jul 22 '24 20:07 openshift-ci[bot]

/cherrypick enterprise-4.12

skrthomas avatar Jul 22 '24 20:07 skrthomas

/cherrypick enterprise-4.13

skrthomas avatar Jul 22 '24 20:07 skrthomas

/cherrypick enterprise-4.14

skrthomas avatar Jul 22 '24 20:07 skrthomas

/cherrypick enterprise-4.15

skrthomas avatar Jul 22 '24 20:07 skrthomas

/cherrypick enterprise-4.16

skrthomas avatar Jul 22 '24 20:07 skrthomas

@skrthomas: new pull request created: #79236

In response to this:

/cherrypick enterprise-4.12

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.