clickhouse-js icon indicating copy to clipboard operation
clickhouse-js copied to clipboard

LZ4, BZ2, snappy compression support

Open slvrtrn opened this issue 2 years ago • 2 comments

Added in 22.10: https://github.com/ClickHouse/ClickHouse/pull/42071

slvrtrn avatar Oct 20 '22 14:10 slvrtrn

We should consider switching to lz4 as a default compression algorithm. ClickHouse compresses gzip in a single thread, which is slower than alternatives.

java client uses lz4 by default python client switched to lz4 in v0.5.0 https://github.com/ClickHouse/clickhouse-connect/pull/95

mshustov avatar Jan 19 '23 16:01 mshustov

LZ4 is blocked:

  • https://github.com/pierrec/node-lz4 does not support modern Node.js versions
  • https://github.com/antoniomuso/lz4-napi lacks streaming support

slvrtrn avatar Feb 02 '23 06:02 slvrtrn