chdb support

[lmangani]

Hello @roman-boiko

Thanks for sharing this example. This runner seems to execute clickhouse-local using the classic pipe mechanism and nodejs exec.

In contrast chdb supports in-process / library based execution of ClickHouse in python and nodejs (amongst other runtimes) with several optimizations on the memory and startup time front for session queries without giving up any feature.

Would there be any interest in an alternative version of this example using chdb/python instead of clickhouse-local/node? We have a python based lambda example available in development.

Thanks!

[ekrasikov]

thank you @lmangani, this sounds like a great idea and should improve performance, we'll check it. PRs are always welcome ;-)

BTW another interesting approach to optimize performance for AWS Lambda is to integrate AWS Lambda C++ Runtime directly into ClickHouse. However, this is way more development effort.

[lmangani]

Thanks @ekrasikov with a bit of help we might be able to unify our chdb example with this one.

Note chdb already offers low-level optimized C++ memory access to the clickhouse core 🎉

[auxten]

AWS Lambda C++ Runtime is interesting. I will see what can be done on chDB with it