abnormal resource usage

[sunqiao01]

What happened?

1、linux platform environment：Linux ds 5.15.0-91-generic #101-Ubuntu SMP Tue Nov 14 13:30:08 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 2、CPU configuration:

CPU Architecture: x86_64 (64-bit)

CPU Modes: 32-bit, 64-bit

Number of CPUs: 4

Online CPU List: 0-3

Vendor ID: GenuineIntel

CPU Model: Intel(R) Xeon(R) Gold 6330 CPU @ 2.00GHz

CPU Family: 6

Model: 106

Threads per Core: 1

Cores per Socket: 1

Number of CPU Sockets: 4

BogoMIPS: 3990.62

Supported Flags: fpu, vme, de, pse, tsc, msr, pae, mce, cx8, apic, sep, mtrr, pge, mca, cmov, pat, pse36, clflush, mmx, fxsr, sse, sse2, ss, syscall, nx, pdpe1gb, rdtscp, lm, constant_tsc, arch_perfmon, nopl, xtopology, log2, tsc_reliable, nonstop_tsc, cpuid, tsc_known_freq, pni, pclmulqdq, ssse3, fma, cx16, pcid, sse4_1, sse4_2, x2apic, movbe, popcnt, tsc_deadline_timer, aes, xsave, avx, f16c, rdrand, hypervisor, lahf_lm, abm, 3dnowprefetch, cpuid_fault, invpcid_single, ssbd, ibrs, ibpb, stibp, ibrs_enhanced, fsgsbase, tsc_adjust, bmi1, avx2, smep, bmi2, invpcid, avx512f, avx512dq, rdseed, adx, smap, avx512ifma, clflushopt, clwb, avx512cd, sha_ni, avx512bw, avx512vl, xsaveopt, xsavec, xgetbv1, xsaves, wbnoinvd, arat, avx512vbmi, umip, pku, ospke, avx512_vbmi2, gfni, vaes, vpclmulqdq, avx512_vnni, avx512_bitalg, avx512_vpopcntdq, rdpid, md_clear, flush_l1d, arch_capabilities

Virtualization Features: Hypervisor vendor: VMware, Virtualization type: full

Caches (sum of all):

L1d: 192 KiB (4 instances) L1i: 128 KiB (4 instances) L2: 5 MiB (4 instances) L3: 168 MiB (4 instances) NUMA Information:

NUMA Nodes: 1 NUMA Node0 CPU(s): 0-3 Vulnerabilities:

Gather Data Sampling: Unknown: Dependent on hypervisor status Itlb Multihit: KVM: Mitigation: VMX unsupported L1tf: Not affected MDS: Not affected Meltdown: Not affected Mmio Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Retbleed: Not affected Spec Rstack Overflow: Not affected Spec Store Bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Spectre v2: Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence Srbds: Not affected Tsx Async Abort: Not affected 3、no business running 4、The memory usage displayed by pprof is significantly different from the memory usage observed through ps or under /proc//smaps，detail messages are showing in Attachment file。The discrepancy arises because pprof displays the memory allocation during the runtime of the Go program, whereas what we are focusing on is the latter, which is the overall resource utilization of the entire process as seen under /proc/probid/smaps. data.zip

Tetragon Version

version=dc88531

Kernel Version

Linux ds 5.15.0-91-generic #101-Ubuntu SMP Tue Nov 14 13:30:08 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Kubernetes Version

No response

Bugtool

No response

Relevant log output

No response

Anything else?

No response

[willfindlay]

Hi, what exactly is the abnormal resource usage here? If it's simply a disparity between pprof and /proc then this is probably an issue for pprof, not Tetragon.

[mtardy]

Hey, it's been almost 3 months since we added the https://github.com/cilium/tetragon/labels/more-info-needed label, I will close this issue now, feel free to reopen or comment this if you want to pursue and provide more info to us :)