Dashboard Init failed

[chirshan]

Everytime I open the Endpoint dashboard I get an Error Message:

[mattttt]

@chirshan Which dashboard in particular is this? The Endpoint Summary? Or any of the Endpoint dashboards?

[chirshan]

@mattttt It's the Endpoint Summary Dashboard. There aren't any Errors in the logfile, so I cannot give any futher information.

[mattttt]

We've gotten ~5 reports of the following error when loading endpoint dashboards, the main commonality seems to be that Grafana is behind a firewall, however they have been successfully able to add endpoints - so it isnt blocking all traffic to worldping-api.

@woodsaj I think we need your help here, @torkelo & @DanCech tried to lend a hand but didnt have much insight.

[woodsaj]

This is odd. The error indicates that the graphite find query to populate the template vars failed. But the green hearts in the screenshot indicate that the API queries to get the check health worked, so the user can reach the worldping-api backend and has a valid apiKey.

Really need the to see the request/response from a browser developer console to identify the specific query that is failing and the failure mode.

[torkelo]

they also mentioned that making a new api key solved the issue, which is also pretty strange :)

[chirshan]

so if you guys need anything from me, say it :) I live in germany, so it can take some time when I answer, but I will :)

[woodsaj]

@chirshan we believe that this issue was due to a bug in Grafana which was fixed in the latest release (3.0.3). Can you try upgrading to the latest grafana and seeing if the problem is now resolved.

[chirshan]

@woodsaj I've updated Grafana to 3.0.4 and the problem still appers.

[torkelo]

Yes, I don't think this is a grafana issue or at least it looks like an api error or communication issue.

[digrich]

Not specific to WorldPing but I think we can reproduce this issue on any grafana dashboard.

Steps to reproduce :

Grafana Version - 3.0.3 DB - OpenTSDB

• Create query template and select 'On Dashboard Load' refresh option. Save it
• Come back and change the same query template to custom, add some data and save it.
• Reload the dashboard and it shows this error.

It looks, though we have custom query template, it still tries to refresh internally from the query template.

[chirshan]

Did you made any progress here? The problem still exists.

[woodsaj]

@torkelo i have just been troubleshooting this more and this definitely looks like a core grafana issue. What leads me to that conclusion is that every type of datasource failure i have deliberately triggered, 500 response, 400 response, timeout etc.. results in the error message being set with a valid reason, eg "Dashboard init failed Template variables could not be initialized: Internal Server Error"

So the "cannot read property 'message' of null" is because promise returned from templateValuesSrv.updateOptions() is being rejected with a null reason. https://github.com/grafana/grafana/blob/1ea54049d07c4cc7959e20a6f9b6ffde24e670b4/public/app/features/templating/editorCtrl.js#L108

i am not sure where exactly that is coming from though

[dragonxtek]

I have a similar issue with Grafana 3.1.1

Template variables could not be initialized: Internal Server Error

[nopzor1200]

I think this problem was resolved. A bit hard to track down, but the fix went into Grafana 3.1.x. If anyone is still seeing it, please let us know.

[ghost]

I have a similar issue in Saas Grafana but with 'data':

[simonc6372]

It is unlikely that this is related to the issue reported nearly 4 years ago. If you are a worldPing customer, please raise a support ticket at [email protected] in the first instance.