ipmi_exporter icon indicating copy to clipboard operation
ipmi_exporter copied to clipboard
verified publisher icon prometheus-community

dell server use ipmi_exporter don't get info

Open Eternity-lzy opened this issue 7 months ago • 4 comments

Information can be obtained using IPMI sensors

ipmi-sensors -h x.x.x.x -u xxx -p xxx --privilege-level=ADMIN -D LAN_2_0

prometheus show DOWN

Error scraping target: Get "http://x.x.x.x:9290/ipmi?module=x.x.x.x&target=x.x.x.x": context deadline exceeded

Eternity-lzy avatar May 22 '25 12:05 Eternity-lzy

Sorry, but you'll have to provide much more details than that. From the looks of it, this is a configuration issue. You'd have to post the relevant snippets from your prometheus config and your exporter config.

bitfehler avatar Jun 20 '25 10:06 bitfehler

Most other machines can obtain it,Some machines (including DELL) are not allowed,But using the ipmi-sensors command can obtain.

prometheus version 3.2.1 `

 - job_name: ipmi_exporter
    params:
      module: ['default']
    scrape_interval: 1m
    scrape_timeout: 30s
    metrics_path: /ipmi
    #metrics_path: /metrics
    scheme: http
    file_sd_configs:
    - files:
      - /root/ipmi_targets.yml
      refresh_interval: 5m
    relabel_configs:
    - source_labels: [__address__]
      target_label: __param_target
    - source_labels: [__meta_ipmi_module]
      target_label: __param_module
    - target_label: __address__
      replacement: 10.1.17.194:9290

`

ipmi_exporter version 1.10.0 `

# ipmi_target.yml:
- targets:
  - 10.1.254.164
  labels:
    bmc_ip: 10.1.254.164
    __meta_ipmi_module: "10.1.254.164"


# ipmi_remote.yml
10.1.254.164:
    user: "root"
    pass: "root@123"

`

Eternity-lzy avatar Jun 23 '25 12:06 Eternity-lzy

One thing that sticks out: you use --privilege-level=ADMIN in the command. If that is required, you should probably also set privilege: "admin" in the exporter config. However, that is an unlikely cause for a timeout.

Some questions:

  1. Are you running the exporter on bare metal or Docker?
  2. Did you run the ipmi-sensors command on the same host that the exporter is running on?
  3. Can you post the exporter's log output? Ideally even with --log.level=debug?

bitfehler avatar Jul 11 '25 09:07 bitfehler

This device can obtain data using ipmi-sensor 1.Running on a bare metal server, with CentOS 7.9 os 2.The ipmi-sensors command and exporter are running on the same machine 3. IP 254.103 is one of the servers ,Several other machines of the same model and configuration as this one can obtain data,This device can obtain data using ipmi-sensor

time=2025-07-28T09:39:28.577Z level=INFO source=main.go:107 msg="Starting ipmi_exporter" version="(version=1.10.0, branch=non-git, revision=non-git)"
    2 time=2025-07-28T09:39:28.655Z level=INFO source=config.go:281 msg="Loaded config file" path=ipmi_tmp.yml
    3 time=2025-07-28T09:39:28.722Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9290
    4 time=2025-07-28T09:39:28.723Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9290
    5 time=2025-07-28T09:39:31.575Z level=DEBUG source=main.go:75 msg="Scraping target" target=10.1.254.60 module=10.1.254.60
    6 time=2025-07-28T09:39:31.576Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.60 collector=ipmi
    7 time=2025-07-28T09:39:31.577Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmimonitoring args="[--quiet-cache --ignore-unrecognized-events --comma-separated-output --no-header-o      utput --sdr-cache-recreate --output-event-bitmask --output-sensor-state --config-file /tmp/ipmi_exporter-5221e5e1d954101aeb1b950875ae049b -h 10.1.254.60]"
    8 time=2025-07-28T09:39:32.603Z level=DEBUG source=main.go:75 msg="Scraping target" target=10.1.254.103 module=10.1.254.103
    9 time=2025-07-28T09:39:32.604Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.103 collector=ipmi
   10 time=2025-07-28T09:39:32.604Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmimonitoring args="[--quiet-cache --ignore-unrecognized-events --comma-separated-output --no-header-o      utput --sdr-cache-recreate --output-event-bitmask --output-sensor-state --config-file /tmp/ipmi_exporter-a042e226e0e7e30b155ad1f9dc51baa5 -h 10.1.254.103]"
   11 time=2025-07-28T09:39:32.676Z level=ERROR source=collector_ipmi.go:150 msg="Failed to collect sensor data" target=10.1.254.103 error="error running ipmimonitoring: exit status 1: ipmi_ctx_op      en_outofband: command invalid or unsupported\n"
   12 time=2025-07-28T09:39:32.677Z level=ERROR source=collector.go:120 msg="Collector failed" name=ipmi error="error running ipmimonitoring: exit status 1: ipmi_ctx_open_outofband: command invali      d or unsupported\n"
   13 time=2025-07-28T09:39:32.677Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.103 collector=dcmi
   14 time=2025-07-28T09:39:32.678Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmi-dcmi args="[--get-system-power-statistics --config-file /tmp/ipmi_exporter-de67c59d61f1b1e4a2d9258      b9b820315 -h 10.1.254.103]"
   15 time=2025-07-28T09:39:32.713Z level=ERROR source=collector_dcmi.go:52 msg="Failed to collect DCMI data" target=10.1.254.103 error="error running ipmi-dcmi: exit status 1: ipmi_ctx_open_outof      band: command invalid or unsupported\n"
   16 time=2025-07-28T09:39:32.713Z level=ERROR source=collector.go:120 msg="Collector failed" name=dcmi error="error running ipmi-dcmi: exit status 1: ipmi_ctx_open_outofband: command invalid or       unsupported\n"
   17 time=2025-07-28T09:39:32.713Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.103 collector=bmc
   18 time=2025-07-28T09:39:32.714Z level=DEBUG source=freeipmi.go:166 msg=Executing command=bmc-info args="[--config-file /tmp/ipmi_exporter-6d2d6dbf0ddb2bddd574acebd2c9bfce -h 10.1.254.103]"
   19 time=2025-07-28T09:39:32.743Z level=ERROR source=collector_bmc.go:52 msg="Failed to collect BMC data" target=10.1.254.103 error="error running bmc-info: exit status 1: ipmi_ctx_open_outofban      d: command invalid or unsupported\n"
   20 time=2025-07-28T09:39:32.743Z level=ERROR source=collector.go:120 msg="Collector failed" name=bmc error="error running bmc-info: exit status 1: ipmi_ctx_open_outofband: command invalid or un      supported\n"
   21 time=2025-07-28T09:39:32.743Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.103 collector=chassis
   22 time=2025-07-28T09:39:32.743Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmi-chassis args="[--get-chassis-status --config-file /tmp/ipmi_exporter-a2c7b777e1788178964230e7e0bcb      777 -h 10.1.254.103]"
   23 time=2025-07-28T09:39:32.789Z level=ERROR source=collector_chassis.go:64 msg="Failed to collect chassis data" target=10.1.254.103 error="error running ipmi-chassis: exit status 1: ipmi_ctx_o      pen_outofband: command invalid or unsupported\n"
   24 time=2025-07-28T09:39:32.789Z level=ERROR source=collector.go:120 msg="Collector failed" name=chassis error="error running ipmi-chassis: exit status 1: ipmi_ctx_open_outofband: command inval      id or unsupported\n"
   25 time=2025-07-28T09:39:32.789Z level=DEBUG source=collector.go:86 msg="Scrape duration" target=10.1.254.103 duration=0.18525304
   26 time=2025-07-28T09:39:33.957Z level=DEBUG source=main.go:75 msg="Scraping target" target=10.1.254.61 module=10.1.254.61
   27 time=2025-07-28T09:39:33.958Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.61 collector=ipmi
   28 time=2025-07-28T09:39:33.959Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmimonitoring args="[--quiet-cache --ignore-unrecognized-events --comma-separated-output --no-header-o      utput --sdr-cache-recreate --output-event-bitmask --output-sensor-state --config-file /tmp/ipmi_exporter-9f06d8306f7d989f7aa0d961b96c94ec -h 10.1.254.61]"
   29 time=2025-07-28T09:39:51.813Z level=ERROR source=collector_ipmi.go:150 msg="Failed to collect sensor data" target=10.1.254.60 error="error running ipmimonitoring: exit status 1: ipmi_ctx_ope      n_outofband: session timeout\n"
   30 time=2025-07-28T09:39:51.813Z level=ERROR source=collector.go:120 msg="Collector failed" name=ipmi error="error running ipmimonitoring: exit status 1: ipmi_ctx_open_outofband: session timeou      t\n"
   31 time=2025-07-28T09:39:51.813Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.60 collector=dcmi
   32 time=2025-07-28T09:39:51.814Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmi-dcmi args="[--get-system-power-statistics --config-file /tmp/ipmi_exporter-b5fcd45896602b9a64bf40c      498254552 -h 10.1.254.60]"
   33 time=2025-07-28T09:39:54.104Z level=ERROR source=collector_ipmi.go:150 msg="Failed to collect sensor data" target=10.1.254.61 error="error running ipmimonitoring: exit status 1: ipmi_ctx_ope      n_outofband: session timeout\n"
   34 time=2025-07-28T09:39:54.104Z level=ERROR source=collector.go:120 msg="Collector failed" name=ipmi error="error running ipmimonitoring: exit status 1: ipmi_ctx_open_outofband: session timeou      t\n"
   35 time=2025-07-28T09:39:54.104Z level=DEBUG source=collector.go:102 msg="Running collector" target=10.1.254.61 collector=dcmi
   36 time=2025-07-28T09:39:54.105Z level=DEBUG source=freeipmi.go:166 msg=Executing command=ipmi-dcmi args="[--get-system-power-statistics --config-file /tmp/ipmi_exporter-b4e47817e93c99185d9ea27      22cb74e37 -h 10.1.254.61]"

Eternity-lzy avatar Jul 28 '25 12:07 Eternity-lzy