mattermost-plugin-alertmanager Error with plugin

Hello! I'm using mattermost 7.1.2 and plugin 0.2.0 and i recieve errors when aletmanager sends alerts.

Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.329 +03:00","level":"info","msg":"Received alertmanager notification","caller":"app/plugin_api.go:937","plugin_id":"alertmanager"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.337 +03:00","level":"error","msg":"plugin process exited","caller":"plugin/hclog_adapter.go:79","plugin_id":"alertmanager","wrapped_extras":"pathplugins/alertmanager/server/dist/plugin-linux-amd64pid4809errorexit status 2"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.338 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"session shutdown"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.339 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"unexpected EOF"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.340 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"unexpected EOF"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.671 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.830 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:14.999 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:15.034 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:15.422 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:15.690 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:15.844 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:15.889 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:16 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:16.670 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:16 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:16.803 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:17 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:17.016 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:17 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:17.199 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:17 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:17.553 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:18 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:18.788 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.335 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.335 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":11,"error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.340 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.340 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":13,"error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.372 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.599 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.672 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.672 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":15,"error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.831 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.831 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":17,"error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.957 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.999 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":19,"error":"timeout waiting for accept"}
Aug 26 16:32:19 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:19.999 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.036 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.036 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":21,"error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.423 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.424 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":23,"error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.593 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.690 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":25,"error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.690 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.845 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.845 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":27,"error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.890 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:20 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:20.890 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":29,"error":"timeout waiting for accept"}
Aug 26 16:32:21 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:21.208 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:21 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:21.672 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:21 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:21.672 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":31,"error":"timeout waiting for accept"}
Aug 26 16:32:21 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:21.804 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:21 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:21.804 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":33,"error":"timeout waiting for accept"}
Aug 26 16:32:21 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:21.978 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:22 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:22.017 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:22 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:22.017 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":35,"error":"timeout waiting for accept"}
Aug 26 16:32:22 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:22.199 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:22 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:22.200 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":37,"error":"timeout waiting for accept"}
Aug 26 16:32:22 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:22.554 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:22 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:22.554 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":39,"error":"timeout waiting for accept"}
Aug 26 16:32:23 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:23.789 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:23 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:23.789 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":41,"error":"timeout waiting for accept"}
Aug 26 16:32:24 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:24.242 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 16:32:24 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:24.373 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:400","plugin_id":"alertmanager","error":"timeout waiting for accept"}
Aug 26 16:32:24 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 16:32:24.373 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:381","plugin_id":"alertmanager","serve_http_stream_id":43,"error":"timeout waiting for accept"}

alertmanager config

  resolve_timeout: 3m
  slack_api_url: 'http://10.243.22.39:8065/plugins/alertmanager/api/webhook?token=REAL_TOKEN'
templates:
- '/etc/alertmanager/templates/*.tmpl'
receivers:
- name: slack
  slack_configs:
  - channel: alerts
    color: '{{ if eq .Status "firing" }}danger{{ else }}good{{ end }}'
    send_resolved: true
    text: "some text"
    title: '{{ if eq .Status "firing" }}Firing {{ .Alerts.Firing | len }}{{ else }}Resolved
      {{ .Alerts.Resolved | len }}{{ end }} alerts'

route:
  group_by:
  - alertname
  - instance
  - service
  - host_name
  group_interval: 5m
  group_wait: 30s
  receiver: slack
  repeat_interval: 3h

Aug 26 '22 13:08 kadet77rus

I've found next(look on 8 line):

Aug 26 17:43:38 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:43:38.968 +03:00","level":"debug","msg":"starting plugin","caller":"plugin/hclog_adapter.go:52","plugin_id":"alertmanager","wrapped_extras":"pathplugins/alertmanager/server/dist/plugin-linux-amd64args[plugins/alertmanager/server/dist/plugin-linux-amd64]"}
Aug 26 17:43:38 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:43:38.969 +03:00","level":"debug","msg":"plugin started","caller":"plugin/hclog_adapter.go:52","plugin_id":"alertmanager","wrapped_extras":"pathplugins/alertmanager/server/dist/plugin-linux-amd64pid5039"}
Aug 26 17:43:38 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:43:38.969 +03:00","level":"debug","msg":"waiting for RPC address","caller":"plugin/hclog_adapter.go:52","plugin_id":"alertmanager","wrapped_extras":"pathplugins/alertmanager/server/dist/plugin-linux-amd64"}
Aug 26 17:43:39 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:43:39.023 +03:00","level":"debug","msg":"plugin address","caller":"plugin/hclog_adapter.go:52","plugin_id":"alertmanager","wrapped_extras":"address/tmp/plugin1270425585networkunixtimestamp2022-08-26T17:43:39.022+0300"}
Aug 26 17:43:39 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:43:39.023 +03:00","level":"debug","msg":"using plugin","caller":"plugin/hclog_adapter.go:52","plugin_id":"alertmanager","wrapped_extras":"version1"}
Aug 26 17:43:39 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:43:39.112 +03:00","level":"debug","msg":"Received HTTP request","caller":"web/handlers.go:156","method":"POST","url":"/api/v4/plugins/alertmanager/enable","request_id":"jo7uy7u8gj858y753qk38ddhao","status_code":"200"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.335 +03:00","level":"info","msg":"Received alertmanager notification","caller":"app/plugin_api.go:937","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"panic: runtime error: invalid memory address or nil pointer dereference","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0xf035b5]","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"goroutine 30 [running]:","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"main.(*Plugin).handleWebhook(0xc000560a80, {0x146be90, 0xc00066a580}, 0xc0000f4100)","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\tgithub.com/cpanato/mattermost-plugin-alertmanager/server/webhook.go:28 +0x115","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"main.(*Plugin).ServeHTTP(0xc000560a80, 0x10e6e40, {0x146be90, 0xc00066a580}, 0xc0000f4100)","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\tgithub.com/cpanato/mattermost-plugin-alertmanager/server/plugin.go:95 +0x233","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"github.com/mattermost/mattermost-server/v6/plugin.(*hooksRPCServer).ServeHTTP(0xc0003710c0, 0xc000370620, 0x1)","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\tgithub.com/mattermost/mattermost-server/[email protected]/plugin/client_rpc.go:456 +0x36e","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"reflect.Value.call({0xc0000b3f20, 0xc0000b0b50, 0x13}, {0x1132104, 0x4}, {0xc000490ef8, 0x3, 0x3})","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\treflect/value.go:543 +0x814","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"reflect.Value.Call({0xc0000b3f20, 0xc0000b0b50, 0xc00017ee40}, {0xc00004eef8, 0x3, 0x3})","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\treflect/value.go:339 +0xc5","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"net/rpc.(*service).call(0xc000358540, 0x0, 0x0, 0xc00054b0c0, 0xc0000f7b00, 0xc000561020, {0xf6e280, 0xc000370620, 0xa37ce6}, {0xf7e200, ...}, ...)","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\tnet/rpc/server.go:377 +0x239","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"created by net/rpc.(*Server).ServeCodec","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.340 +03:00","level":"debug","msg":"\tnet/rpc/server.go:474 +0x405","caller":"plugin/hclog_adapter.go:54","plugin_id":"alertmanager"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.343 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"unexpected EOF"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.344 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"unexpected EOF"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.345 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"unexpected EOF"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.347 +03:00","level":"error","msg":"plugin process exited","caller":"plugin/hclog_adapter.go:79","plugin_id":"alertmanager","wrapped_extras":"pathplugins/alertmanager/server/dist/plugin-linux-amd64pid5039errorexit status 2"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.754 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.759 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.888 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:14 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:14.942 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:15.252 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:15.499 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:15.760 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:15 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:15.839 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:16 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:16.280 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:16 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:16.924 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:17 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:17.069 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}
Aug 26 17:44:17 mattermost-1.node.1520.consul mattermost[4617]: {"timestamp":"2022-08-26 17:44:17.294 +03:00","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:426","plugin_id":"alertmanager","error":"connection is shut down"}

Aug 26 '22 14:08 kadet77rus

Could you please test with https://github.com/cpanato/mattermost-plugin-alertmanager/releases/tag/v0.4.0?

Feb 02 '23 09:02 hanzei

Thanks, i'll test it in march

Feb 20 '23 08:02 kadet77rus

closing this, if this still an issue please reopen

Mar 13 '23 12:03 cpanato

So, i have another error, which related to arch. This plugin failed to start. unable to start plugin: alertmanager: Unrecognized remote plugin message: This usually means the plugin was not compiled for this architecture, the plugin is missing dynamic-link libraries necessary to run, the plugin is not executable by this process due to file permissions, or the plugin failed to negotiate the initial go-plugin protocol handshake Additional notes about plugin: Path: plugins/alertmanager/server/dist/plugin-linux-amd64 Mode: -rwxr-xr-x Owner: 498 [mattermost] (current: 498 [mattermost]) Group: 498 [mattermost] (current: 498 [mattermost]) ELF architecture: EM_X86_64 (current architecture: amd64)

Mar 20 '23 09:03 kadet77rus

Fix it with CGO_ENABLED=0 env in go build

Mar 20 '23 11:03 kadet77rus

@cpanato Can you help me to configure it? I have installed plugin, added bot to team and channel. In the log i see received messages by alertmanager, but i can't see them in the channel.

Alertmanager config section:

- name: slack
  slack_configs:
  - send_resolved: true
    http_config:
      follow_redirects: true
    api_url: <secret>
    channel: dev-alerts
    username: '{{ template "slack.default.username" . }}'
    color: '{{ if eq .Status "firing" }}danger{{ else }}good{{ end }}'
    title: '{{ if eq .Status "firing" }}Firing {{ .Alerts.Firing | len }}{{ else }}Resolved
      {{ .Alerts.Resolved | len }}{{ end }} alerts'```

Mar 20 '23 16:03 kadet77rus