instrumenting-java-apps-using-opentelemetry icon indicating copy to clipboard operation
instrumenting-java-apps-using-opentelemetry copied to clipboard

Grafana throwing broken pipe error.

Open sakibul-munna opened this issue 2 years ago • 0 comments

I am following the YouTube playlist. At this moment, I am at the Sending generated traces to Grafana Tempo section. But I am stuck at a point where Grafana is throwing this error,

grafana | logger=context userId=0 orgId=1 uname= t=2023-09-07T[06:41:37](https://www.youtube.com/watch?v=V5GtJRZtZ90&t=24097s).619090527Z level=error msg="Request error" error="Context.HTML:write tcp 127.0.0.1:3000->127.0.0.1:55340: write: broken pipe".

This error has been continuously thrown. Apart from that, another log is being printed on the console, that is,

tempo | level=info ts=2023-09-07T07:25:29.394063056Z caller=compactor.go:101 msg="starting compaction cycle" tenantID=single-tenant offset=0 tempo | level=info ts=2023-09-07T07:25:29.394119656Z caller=compactor.go:107 msg="compaction cycle complete. No more blocks to compact" tenantID=single-tenant

In one reply to a youtube comment, you suggested changing the latest to a specific version inside the docker-compose file. I already did that but nothing is fixed.

It would be great if you could help me out.

Here is the docker compose file of mine,

version: '3.0'

services:

  collector:
    image: otel/opentelemetry-collector:latest
    container_name: collector
    hostname: collector
    depends_on:
      tempo:
        condition: service_healthy
      prometheus:
        condition: service_healthy
    command: ["--config=/etc/collector-config.yaml"]
    volumes:
      - ./collector-config-local.yaml:/etc/collector-config.yaml
    ports:
      - "5555:5555"
      - "6666:6666"

  tempo:
    image: grafana/tempo:1.5.0
    command: [ "-search.enabled=true", "-config.file=/etc/tempo.yaml" ]
    container_name: tempo
    hostname: tempo
    volumes:
      - ./o11y-backend/tempo-config.yaml:/etc/tempo.yaml
      - ./o11y-backend/tempo-overrides.yaml:/etc/overrides.yaml
      - ./tempo-data:/tmp/tempo
    ports:
      - "3200:3200"
      - "4317:4317"
    healthcheck:
      interval: 5s
      retries: 10
      test: wget --no-verbose --tries=1 --spider http://localhost:3200/status || exit 1

  prometheus:
    image: prom/prometheus:v2.39.2
    container_name: prometheus
    hostname: prometheus
    command:
      - --config.file=/etc/prometheus.yaml
      - --web.enable-remote-write-receiver
      - --enable-feature=exemplar-storage
    volumes:
      - ./o11y-backend/prometheus.yaml:/etc/prometheus.yaml
    ports:
      - "9090:9090"
    healthcheck:
      interval: 5s
      retries: 10
      test: wget --no-verbose --tries=1 --spider http://localhost:9090/status || exit 1

  grafana:
    image: grafana/grafana:9.2.2
    container_name: grafana
    hostname: grafana
    depends_on:
      tempo:
        condition: service_healthy
      prometheus:
        condition: service_healthy
    volumes:
      - ./o11y-backend/grafana-bootstrap.ini:/etc/grafana/grafana.ini
      - ./o11y-backend/grafana-datasources.yaml:/etc/grafana/provisioning/datasources/datasources.yaml
    environment:
      - GF_AUTH_ANONYMOUS_ENABLED=true
      - GF_AUTH_ANONYMOUS_ORG_ROLE=Admin
      - GF_AUTH_DISABLE_LOGIN_FORM=true
    ports:
      - "3000:3000"
    healthcheck:
      interval: 5s
      retries: 10
      test: wget --no-verbose --tries=1 --spider http://localhost:3000 || exit 1

networks:
  default:
    name: inst-java-apps-using-otel 

sakibul-munna avatar Sep 07 '23 07:09 sakibul-munna