conntracct icon indicating copy to clipboard operation
conntracct copied to clipboard

Support ClickHouse instead of ElasticSearch + InfluxDB

Open Slach opened this issue 5 years ago • 4 comments

https://clickhouse.yandex/docs/en/ it's a blazing fast columnar analytics database which can be used a metrics storage with good compression and delta coding mechanism

Slach avatar Apr 20 '20 16:04 Slach

Hi @Slach, thank you for the suggestion. Never used ClickHouse before.

As I have limited bandwidth, and I currently have no desire to add support for anything other than Prometheus, would you be willing to contribute? That said, there's a chance I might drop influxdb support sooner or later, focusing exclusively on ES (for historic totals) and Prometheus (for a combination of real-time and historical trends and rates).

ti-mo avatar Apr 21 '20 12:04 ti-mo

ok. if you will support prometheus I think it's enough I will use VictoriaMetrics for long term storage

Maybe later I can contribute Only if find free time

Slach avatar Apr 21 '20 13:04 Slach

Any updates on Prometheus?

mrbluecoat avatar Jul 23 '22 13:07 mrbluecoat

Thanks for the interest, haven't worked on this in a while. Might pick this back up around the end of the year, but I'd like us to finish kernel module CO-RE support in ebpf-go first. Then I can get rid of the hacky way conntracct targets different kernel versions, and we'd only support BTF-enabled kernels.

The elastic driver will probably be removed in favour of Clickhouse and Prometheus, but atm this project is far down on my list of priorities, sorry. I'm definitely happy to take any patches if you have any.

ti-mo avatar Jul 23 '22 19:07 ti-mo