grafana-image-renderer icon indicating copy to clipboard operation
grafana-image-renderer copied to clipboard

v3.11.4: it has been failing to build images with an HTTP 502 error

Open bicefalo opened this issue 4 months ago • 0 comments

What happened: While attempting to rebuild a Grafana instance on AWS, I encountered the following error in the logs:

nrecognized remote plugin message: \nFailed to read any lines from plugin's stdout\nThis usually means\n the plugin was not compiled for this architecture,\n the plugin is missing dynamic-link libraries necessary to run,\n the plugin is not executable by this process due to file permissions, or\n the plugin failed to negotiate the initial go-plugin protocol handshake\n\nAdditional notes about plugin:\n Path: /var/lib/grafana/plugins/grafana-image-renderer/plugin_start_linux_amd64\n Mode: -rwxr-xr-x\n Owner: 0 [root] (current: 997 [grafana])\n Group: 0 [root] (current: 7821 [grafana])\n ELF architecture: EM_X86_64 (current architecture: amd64)\n" logger=plugin.grafana-image-renderer t=2024-10-02T13:44:42.866321393Z level=error msg="plugin process exited" plugin=/var/lib/grafana/plugins/grafana-image-renderer/plugin_start_linux_amd64 id=4740 error="exit status 1" logger=grafana-apiserver t=2024-10-02T13:44:42.867145796Z level=info msg="StorageObjectCountTracker pruner is exiting" logger=tracing t=2024-10-02T13:44:42.867931664Z level=info msg="Closing tracing" logger=plugin.grafana-image-renderer t=2024-10-02T13:44:42.869308147Z level=warn msg="plugin failed to exit gracefully"

What you expected to happen: Grafana should be able to come up without issues.

How to reproduce it (as minimally and precisely as possible): Install the latest version of Grafana in an ubuntu 22.04. Install the latest plugin version with grafana-cli (grafana-cli plugins install grafana-image-renderer). Start Grafana.

Anything else we need to know?: Reverting to Grafana Image Renderer version 3.11.3 allowed the instance to function correctly. We added the recommended config for debugging the plugin, but didn't provide any extra information about the issue. [log] filters = rendering:debug

Environment: Dev

  • Grafana Image Renderer version: 3.11.4
  • Grafana version: 10.4.2, 11.2.1
  • Installed plugin or remote renderer service: Installed plugin
  • OS Grafana Image Renderer is installed on: The same server as grafana /var/lib/grafana/plugins/grafana-image-renderer/plugin_start_linux_amd64.
  • User OS & Browser: Ubuntu 22.04
  • Others: -

bicefalo avatar Oct 02 '24 16:10 bicefalo