carbonapi
carbonapi copied to clipboard
go-graphite
Connection issue between carbonapi and prometheus backend
Problem description
Trying to connect carbonapi to prometheus backend, with intention to have data visualization in grafana. But facing issues with connection between carbonapi and prometheus endpoint, carbonapi is trying to hit / query prometheus /api/vi/series endpoint which results in timeout. When I try hit actual query from carbonapi logs, which is https://prometheus-server/api/v1/series?match%5B%5D=%7B__name__%3D~%22.%2A%22%7D&start=1603827016 in the browser I get back following error message {"status":"error","errorType":"bad_data","error":"parse error at char 16: vector selector must contain at least one non-empty matcher"}. Would be really great if I can get some help here, thanks in advance.
carbonapi's version Using carbon api rpm version 0.14.1-1
carbonapi's config
listen: "0.0.0.0:8081"
concurency: 20
cache:
# Type of caching. Valid: "mem", "memcache", "null"
type: "mem"
size_mb: 24576
upstreams:
timeouts:
find: "300s"
global: "300s"
afterStarted: "120s"
connect: "500ms"
backendsv2:
backends:
- groupName: "prometheus"
protocol: "prometheus"
lbMethod: "broadcast"
maxTries: 3
maxBatchSize: 0
keepAliveInterval: "30s"
concurrencyLimit: 0
maxIdleConnsPerHost: 100
backendOptions:
step: "60"
start: "-5m"
max_points_per_query: 5000
timeouts:
find: "300s"
render: "300s"
connect: "500ms"
servers:
- "prometheus-endpoint"
backend software and config Running Prometheus as backend with version v2.7.1
Logs from carbonapi
Oct 27 22:10:14 prometheus-backend-carbon-api carbonapi[4078]: 2020-10-27T22:10:14.295Z ERROR zipper failed to probe tlds {"type": "probe", "errors": "response contains non-fatal errors: max tries exceeded: failed to fetch data from server/group: Get
