Better juju status message when `/var/lib/prometheus` is full

[WizardBit]

Enhancement Proposal

Currently when /var/lib/prometheus is full the following message is shown in the output of juju status.

prometheus/0*              blocked   idle       172.16.1.135         Prometheus failed to restart (config valid?); see debug logs

juju debug-log eventually shows the following:

caller=main.go:1270 level=error err="opening storage failed: lock DB directory: open /var/lib/prometheus/lock: no space left on device"

[lucabello]

Hey @WizardBit , IIUC you're suggesting to communicate the no space left on device on the juju status itself, right?

I think we could even - in the logs - refer to a troubleshooting document explaining what to do in that situation and how to free up space. What do you think?

[WizardBit]

Hey @lucabello, yes if there could be a message in the juju status itself mentioning no space left on device would be great.

Referencing to documentation is a good idea. My only concern is that it may differ depending on the storage backend used.