locopy

locopy copied to clipboard

fdosani

Azure Snowflake

1

Snowflake can run off azure now (and gcp sometime this year I think), so we should at least add in the docs that we don't support azure/gcp, and maybe look...

theianrobertson

- Figure we should add Postgres support to `locopy` since Redshift is just a derivative of it. - Might need to refactor the redshift class a bit but shouldn't be...

fdosani

Unload don't create files while concurrency scaling enabled

8

When we enabled concurrency scaling in redshift `locopy.redshift.unload_and_copy` stopped creating files on S3 during critical load and logged the corresponding message: > No files generated from unload Tried both `parquet`...

maxim-lisovsky-gismart

Don't log error if no files unloaded

1

I'm using parquet files for `unload_and_copy`, unload options: `["PARQUET", "PARALLEL ON", "CLEANPATH"]` I get `S3DownloadError` and an error log in case my query returns no rows: > ERROR: No files...

maxim-lisovsky-gismart

We fixed dtype inference for native pandas types, but we still need to extend support for pyarrow-backed data types which seem to be becoming standard. MWE: ```python import pandas as...

jdawang

We should drop 3.8 support as it is now deprecated and look into 3.11 / 3.12 support. I think there are some spots in the docs which might need updating...

fdosani