hyper-api-samples icon indicating copy to clipboard operation
hyper-api-samples copied to clipboard

Published 20 hours ago • verified publisher icon tableau

Request for sample of connection to a external hyperprocess

Open rferraton opened this issue 2 years ago • 2 comments

Would it be possible to have a sample in Python for openning a connection to an hyperprocess that is already openned by another process ? Using tcp and a fix port for exemple.

rferraton avatar May 06 '22 19:05 rferraton

This is not possible. The Hyper API may only connect to the Hyper instances that was started by the process running the Hyper API. This limitation is not due to technical limitations but rather a product decision to limit the usage of Hyper as a general purpose database system.

I am interested in what you are trying to build. Can you describe your scenario?

jkammerer avatar May 09 '22 08:05 jkammerer

I try to load data into hyper table(s) in parallel from several process.

I was asking this because of a post that open an hyper process on a docker and connect to it with separates sessions.

rferraton avatar May 09 '22 09:05 rferraton

The post you linked uses psql to connect to Hyper instead of the HyperAPI. With this, the restriction is bypassed. This is not supported. With the HyperAPI you could spawn multiple Hyper Processes while restricting the memory usage of each one using the "memory_limit" process setting. But I am not sure if you will be able to speed things up with that.

To conclude: Multiple connections to one Hyper Process are not supported and also won't be any time soon.

jkammerer avatar Nov 15 '22 09:11 jkammerer