connector-x
connector-x copied to clipboard
parallel sql run using connectorx
I'm using sqlalchemy + Panda for fetching data from multiple Db sources as Oracle + Postgres . There are~400 queries which are running in parallel and I'd like to understand what would be best approah using connectorx for running with reusing the db connections instead each procces connect > run the query-> close it. I tried to find such example in documentation but couldn't find .
I have a similar use case in that I'd like to select from many tables in a sqlite database, but I don't want to merge the tables together. Being able to reuse a connection would be best, though for my use case, having a function that accepted multiple queries but did not merge them into a single dataframe would still be great.