Peter Bourgon
Peter Bourgon
Yep, you've stumbled over the record size limit. It's actually baked into various places throughout the system, not only in the forwarder. It's definitely fixable, I've just not taken the...
Nope. But I'm happy to turn my attention to it next. Warning: no ETAs ;) Is there a reasonable upper size limit for your use case, after which you'd be...
Goodness! Okay. JSON?
Max size is baked in to several layers in several components, so it's not as easy as just adding a parameter, unfortunately.
Thanks for the report. What's the rough max size of your lines?
Well, sure, but... ``` blep ~/src/github.com/oklog/oklog (master) rg 'bufio.NewScanner' cmd/oklog/stream.go 72: scanner := bufio.NewScanner(resp.Body) cmd/oklog/query.go 157: s := bufio.NewScanner(r) cmd/oklog/forward.go 131: s = bufio.NewScanner(os.Stdin) pkg/ingest/conn_test.go 106: s := bufio.NewScanner(conn) pkg/ingest/conn.go...
Yes! I was reading that initially via a tip from @brapse :)
I've actually built one during benchmarking, I guess it should be straightforward to publish it. Will do at some point. To be clear: you mean a Grafana dashboard to monitor...
@xla Your thoughts?
3 is best, but happy to have 2.