connector-x icon indicating copy to clipboard operation
connector-x copied to clipboard

parallel sql run using connectorx

Open avico78 opened this issue 2 years ago • 1 comments

I'm using sqlalchemy + Panda for fetching data from multiple Db sources as Oracle + Postgres . There are~400 queries which are running in parallel and I'd like to understand what would be best approah using connectorx for running with reusing the db connections instead each procces connect > run the query-> close it. I tried to find such example in documentation but couldn't find .

avico78 avatar Feb 12 '23 11:02 avico78

I have a similar use case in that I'd like to select from many tables in a sqlite database, but I don't want to merge the tables together. Being able to reuse a connection would be best, though for my use case, having a function that accepted multiple queries but did not merge them into a single dataframe would still be great.

mesner avatar Aug 25 '23 15:08 mesner