core
core copied to clipboard
gazette
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
As a Gazette operator, I'd like a dynamic control feedback loop which allows brokers having very busy journals to discharge those journals more equitably around the cluster. Today the allocator...
As an operator, I'd like recovery logs to track multiple segments of written journal range for every file, up to a bound. For RocksDB workloads, all writes of SST files...
Today brokers provide a guarantee that a JournalSpec with R > 1 will be replicated across at least two zones. There's no ability to constrain _which_ zones are selected. As...
As an operator, I'd like Gazette client broker & broker broker connections to transparently use configured compression when speaking with a process in a different zone, in order to reduce...
If a shard fails during processing, it's status is set to FAILED and the relevant error is available through gazctl (bonus: make this more accessible; currently one has to use...
Pod IP changes can happen on pod restart (I see this occasionally with MicroK8s when my laptop sleeps, but have never seen it on a cloud provider). Here's an example...
With [this PR](https://github.com/liveramp/gazette/pull/127) a race condition has been in the `brokertest` package. Johnny's comment on the issue: > But, there's a race here -- multiple `NewBroker` calls may be made...
# Request Provide a way to configure the timeout in seconds for `gazctl` calls. # Background If the address being dialed by gRPC is invalid, it will retry indefinitely (for...
Previously s3 stores could only use the region available via a given profile or the AWS application default credentials. This adds the ability to set an alternate region in the...
Project seems awesome :) I assume from digging into old issues and PRs that it will pull my S3 config from the usual suspected places, haven't had a chance to...
