bandar-log
bandar-log copied to clipboard
Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
@yurir @zsaltys Hi, could you please clarify, if bandar-log could be made fully OSS project and be put under control of its current contributors?
I confirm that this contribution is made under the terms of the license found in the root directory of this repository's source tree and that I have the authority necessary...
Pretty much self-descriptive. Some projects do not have Datadog license, but Bandarlog is a great tool which solves their problems.
Similar to #31, it would be good to have Clickhouse support out of the box
Adding should be pretty straightforward as it is done via JDBC
Right now Bandar-log supports only Datadog as target metrics consumer, but it will definitely be good to support cloud built-in solutions like AWS Cloudwatch (AWS), Stackdriver monitoring (GCP) and Azure...
At the moment, Bandarlog relies on semantics of Kafka, however it could be re-done with more generalized idea of observation of queue-like services. Should be done to enable support of...
We could reuse PagerDuty's metrics library and avoid reporter re-implementation. This would provide more flexibility with metrics creation and reporting.
SQS could be monitored via CloudWatch API. See https://docs.aws.amazon.com/en_us/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-access-metrics.html https://docs.aws.amazon.com/en_us/AmazonCloudWatch/latest/APIReference/API_GetMetricStatistics.html