Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hotproc metrics displayed in grafana without pid & process name #203

Open
mallilinux1980 opened this issue Oct 4, 2024 · 1 comment
Open
Labels
feature New feature or request

Comments

@mallilinux1980
Copy link

i've enabled PCP hotproc metrics using hotproc.conf (cpuburn > 0.10) & also seup sasl based authentication and installed redis as well as grafana everything on a test server.

the real issue I've observed for most metrics example "hotproc.predicate.cpuburn" shows up instances (40digit alpha-numeric number) who're more than 10% CPU usage as per predicate but no PID and PROC name associated with it. Sometime takes its own time and sometimes it doesn't at all.

my env:

  • RHEL8.10
  • PCP 5.3
  • Grafana 9.2
  • grafana-pcp 5.1
  • Redis 5.0

so am I missing anything here?

@mallilinux1980 mallilinux1980 added the feature New feature or request label Oct 4, 2024
@natoscott
Copy link
Member

I've setup hotproc metrics going into Valkey now (Fedora40, pcp-6.3.1) and everything seems to be fine from the PCP end. There may be some effort needed on the Grafana end, not sure, but this is what I see using just PCP tools (i.e. pmseries command line, which talks directly to Valkey/Redis):

nathans@fedora:~/git/pcp$ pmseries hotproc.psinfo.rss
014f2aaf4d97f588a00c52ea3fcc672fbd423ecb
nathans@fedora:~/git/pcp$ pmseries -i `pmseries hotproc.psinfo.rss`| head

014f2aaf4d97f588a00c52ea3fcc672fbd423ecb
    inst [1350 or "001350 /usr/libexec/pcp/bin/pmcd"] series e720ad93a6039f435c0ce497129091b7a59be7c7
    inst [1354 or "001354 /var/lib/pcp/pmdas/root/pmdaroot"] series 782aeda842aac7a4a64a103639976f654d418148
    inst [1360 or "001360 /var/lib/pcp/pmdas/proc/pmdaproc"] series e1ae808971df1715ae8ba61e3135db85cf53e299
    inst [1361 or "001361 /var/lib/pcp/pmdas/xfs/pmdaxfs"] series 2cce339576c439f6f792df35eaf75ba339465892
    inst [1362 or "001362 /var/lib/pcp/pmdas/sample/pmdasample"] series 7e1f58318cc56efa0eeca1de410995ab1229c5de
    inst [1363 or "001363 /var/lib/pcp/pmdas/statsd/pmdastatsd"] series eff572062f652a3f888239be08bf7156f1c76892
    inst [1367 or "001367 /var/lib/pcp/pmdas/linux/pmdalinux"] series 20017f275086c90adfaeb8cdb8d76d4df712f6eb
    inst [1371 or "001371 /usr/bin/python3"] series e0632ae864826d8addcb01a8e8718df6d68d0ae2
nathans@fedora:~/git/pcp$ 

so, the process identifiers and command names (i.e. PCP instances for hotproc metrics), is there - there may be some magic required to display these in Grafana rather than the 40-digit SID (series identifier). @sfeifer or @andreasgerstmayr may be able to help us further there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants