opencensus-node icon indicating copy to clipboard operation
opencensus-node copied to clipboard

Fix: add batch limit for stackdriver exporter

Open mayurkale22 opened this issue 5 years ago • 9 comments

Fixes #634

These changes have all been tested locally against a real stackdriver exporter and been confirmed to be working.

mayurkale22 avatar Aug 26 '19 23:08 mayurkale22

/cc @mluggy Please review.

mayurkale22 avatar Aug 26 '19 23:08 mayurkale22

@draffensperger Please review when you have a time.

mayurkale22 avatar Sep 07 '19 04:09 mayurkale22

Can we merge this and get a release?

ofpiyush avatar Jan 25 '20 18:01 ofpiyush

I'd like to mention another, related problem with exporting Metrics to Stackdriver:

Rate at which data can be written to a single time series: one point each 10 seconds

(used to be even only 1 per minute in December 2019 when I run into this problem)

its still ridiculously low for per-request metrics and also causes millions of API errors, eating up memory and CPU in your service if you dont implement some throttling yourself

this caused us to not even start using Stackdriver Monitoring for custom metrics but ended up using Prometheus again.

philicious avatar May 20 '20 21:05 philicious

Is there a reason this isn't released yet? I'm running into the same issue as #634

6utt3rfly avatar Jan 18 '21 17:01 6utt3rfly

Would be quite nice if this got some attention again. Kinda makes it barely usable with stackdriver.

d-goldin avatar Oct 19 '21 13:10 d-goldin

We're seeing this issue ourselves, is there any workaround available?

mamidon avatar Mar 07 '22 19:03 mamidon

I guess there won't be much love for opencensus anymore as it's deprecated in favor of opentelemetry

philicious avatar Mar 07 '22 21:03 philicious

Bah, that would probably explain it. Of course the GCP docs I read must've been out of date. Thanks for the FYI.

mamidon avatar Mar 07 '22 21:03 mamidon