Client workoad statistics, monitoring

[demalik]

Describe the solution you'd like Capability to track workload patterns of NAS clients talking to a shared NAS volume to identify bully and victims in overloaded volumes Capability to show all the clients mounting a NFS volume i.e. (TCP connection, NFS session), in other words all NFS clients connected to backend NFS storage.

[merdos]

Same request here. The ability to monitor active NFS clients both from an inventory and performance perspective. In ONTAP REST API that is /protocols/nfs/connected-clients

[jmg011]

@merdos Any idea which zapi api will show this? "network connections active show"

I could not find an api with this details. Can you point me to the right one?

[jmg011]

@ruanruijuan Any idea which zapi api will show this? "network connections active show"

I could not find an api with this details. Can you point me to the right one?

[ruanruijuan]

@ruanruijuan Any idea which zapi api will show this? "network connections active show"

I could not find an api with this details. Can you point me to the right one?

@jmg011, you can run the following command to find the ZAPI corresponding for a specific CLI:
security login role show-ontapi -command "cli command" (replace "cli command" with "network connections active show" here). Hope it works for you.

[jmg011]

@ruanruijuan I ran that couple of days back but it did not return any thing.

show-ontapi -command "network connections show" (security login role show-ontapi) There are no entries matching your query.

show-ontapi -command "network connections active show" (security login role show-ontapi) There are no entries matching your query.

[rahulguptajss]

@demalik @merdos Harvest now includes NFS Clients dashboard. It will available in our next official release. If you want to try it early then it can done through our nightly builds. Please note, It is only available with Rest Collector which needs to be enabled for relevant templates as described here for NABox.

@jmg011 We have also included output of cli network connections active show through a Rest only template as mentioned here.

Below is the screenshot of new dashboard.

[faguayot]

Hello @rahulguptajss
I don't get to make work this new panel in my environment. I've created the new file netConnections and I enabled in my custom.yaml for the Rest Collector (also enabled on my harvest.yaml). In fact, I find the new metrics "net_connection_labels" in my prometheus but the NFS Clients dashboard doesn't work. When I checked the queries the metrics in the graph are: nfs_clients_idle_duration but I don't have those name of metrics in my database, another thing I tried is change the metrics which are on the graphs/table for the new metric net_connection_labels but it doesn't work too. I don't know what I missed or I didn't do correctly.

[rahulguptajss]

@faguayot You are right, NFS client dashboard works with metric nfs_clients_idle_duration which comes from Rest template defined nfs_clients.yaml. Template netConnections.yaml is not used in the dashboard as it contains other clients like TCP as well and only shows active connections.

Please check if template nfs_clients.yaml is enabled in your custom.yaml. Thanks

[faguayot]

@rahulguptajss Thank you. Enabling those new metrics, it is working the dashboard. Do you have in mind to enable this one by default in the next release?

Other doubt, the netConnections are using in some dashboard that you have defined in your nightly build. Which kind of information is gathering? I mean, it is similar to NFSClients?

[rahulguptajss]

Great that dashboard works now. We have disabled Rest Collector templates for now to avoid duplicate metrics from Zapi Collector and Rest Collector. More details here. We'll discuss about enabling Rest templates by default and get back to you.

netConnections.yaml template is not used in any dashboard currently. I see 2 differences between netConnections.yaml (uses ONTAP CLI network connections active show) and nfs_clients.yaml(uses Rest call api/protocols/nfs/connected-clients) as below.

1. netConnections.yaml provides connections for several other protocols as well (screenshot below) while nfs_clients.yaml is only for nfs connections.

   

2. netConnections.yaml collects only active NFS connections while nfs_clients.yaml also collects idle NFS connections since last 48 hours by default. So you may see difference in NFS connection count from both templates.

[faguayot]

I have disabled all the Rest Collector in the default.yaml but I have the custom.yaml with other interesting objects for us which are enabled. We do this following your recomendation about disabling for the moment the Rest collections to avoid the duplication and the full of database too.

In fact we're still in ONTAP 9.7 and 9.10 (this version only in some cluster) and for what I know, the Rest collector it is interesting and completed in higger version, I don't remember if it is in 9.11 or 9.12. Also the ZAPI collector is being deprecated for the futurer, right?

Thanks for the clear explanation between netConnections (active connections) and the nfsClients (active/idle nfs connections).

[rahulguptajss]

Yes as mentioned in this document, ONTAP has published a customer product communiqué (CPC-00410) announcing that ZAPIs will reach end of availability (EOA) in ONTAP 9.13.1 released Q2 2023.

[faguayot]

Ok rahul, thanks for sharing this info too.

[rahulguptajss]

verified in 22.11

[merdos]

Thank you Rahul! Mark

On Tue, Nov 15, 2022 at 01:32 Rahul @.***> wrote:

verified in 22.11

— Reply to this email directly, view it on GitHub https://github.com/NetApp/harvest/issues/210#issuecomment-1315036676, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFIQELANNWN5YVANIKN55NTWINKDZANCNFSM47CTZNXQ . You are receiving this because you were mentioned.Message ID: @.***>

-- Mark @.***

[jmg011]

@demalik @merdos Harvest now includes NFS Clients dashboard. It will available in our next official release. If you want to try it early then it can done through our nightly builds. Please note, It is only available with Rest Collector which needs to be enabled for relevant templates as described here for NABox.

@jmg011 We have also included output of cli network connections active show through a Rest only template as mentioned here.

Below is the screenshot of new dashboard.

Thank you. I have been waiting for this. I will definitely try this out soon.