stackdriver_exporter icon indicating copy to clipboard operation
stackdriver_exporter copied to clipboard

Error in scraping bigtable.googleapis.com/server/latencies

Open talonx opened this issue 5 years ago • 0 comments

This started failing around the 17th Dec 2019 - it was running fine before that date.

We run the exporter using

/opt/stackdriver_exporter/stackdriver_exporter --google.project-id <snipped> --monitoring.metrics-type-prefixes "bigtable.googleapis.com,logging.googleapis.com,compute.googleapis.com/instance/uptime" --stackdriver.http-timeout=45s

We ran it in debug mode, and this is the error it fails with

DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/server/returned_rows_count`...  source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/server/sent_bytes_count`...  source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/disk_load`...  source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/cpu_load`...  source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/cpu_load_hottest_node`...  source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/storage_utilization`...  source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/disk/bytes_used`...  source="monitoring_collector.go:172"
ERRO[0030] Error retrieving Time Series metrics for descriptor `bigtable.googleapis.com/server/latencies`: googleapi: Error 500: Failed to convert server response to JSON, backendError  source="monitoring_collector.go:182"
ERRO[0030] Error while getting Google Stackdriver Monitoring metrics: googleapi: Error 500: Failed to convert server response to JSON, backendError  source="monitoring_collector.go:138"

talonx avatar Jan 22 '20 11:01 talonx