automq
automq copied to clipboard
AutoMQ
AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.
Problems may exist when node is suddenly shut down, especially some log is creating or opening. Here are some possible relative cases. ## problems in log creating 1) meta stream...
server.log: ``` [2023-10-12 09:28:08,713] INFO log append cost, permitAcquireFail={count=0, avg=0ns, max=0ns}, remainingPermit=1073712638/1073741824 ,append={count=17692, avg=91us, max=19ms}, callback={count=17694, avg=1ms, max=30ms}, ack={count=15819, avg=385us, max=39ms} (kafka.log.streamaspect.ElasticLog) [2023-10-12 09:28:08,713] INFO [KafkaApi-0] produce cost, produce={count=7293, avg=3ms,...
Use auto balancer to move placement of __consumer_offsets to combined nodes only
- NodeWALMetadataRecord in Kraft - others ...
Currently, the Kafka metrics auto-balancer used for scheduling is based on minute granularity. This can lead to potential scheduling delays. Using a finer-grained time window for metric statistics can make...
## Status Under Discussion ## Motivation To address the issue of regional-level unavailability in object storage services, ensure the write availability and partition migration availability of the Kafka cluster through...