stackdriver_exporter
stackdriver_exporter copied to clipboard
Error in scraping bigtable.googleapis.com/server/latencies
This started failing around the 17th Dec 2019 - it was running fine before that date.
We run the exporter using
/opt/stackdriver_exporter/stackdriver_exporter --google.project-id <snipped> --monitoring.metrics-type-prefixes "bigtable.googleapis.com,logging.googleapis.com,compute.googleapis.com/instance/uptime" --stackdriver.http-timeout=45s
We ran it in debug mode, and this is the error it fails with
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/server/returned_rows_count`... source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/server/sent_bytes_count`... source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/disk_load`... source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/cpu_load`... source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/cpu_load_hottest_node`... source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/cluster/storage_utilization`... source="monitoring_collector.go:172"
DEBU[0030] Retrieving Google Stackdriver Monitoring metrics for descriptor `bigtable.googleapis.com/disk/bytes_used`... source="monitoring_collector.go:172"
ERRO[0030] Error retrieving Time Series metrics for descriptor `bigtable.googleapis.com/server/latencies`: googleapi: Error 500: Failed to convert server response to JSON, backendError source="monitoring_collector.go:182"
ERRO[0030] Error while getting Google Stackdriver Monitoring metrics: googleapi: Error 500: Failed to convert server response to JSON, backendError source="monitoring_collector.go:138"