Support array type for arrow destination on postgres

[IgorDenisenko]

Hello, I'm trying to upload a table from GreenPlum. Several columns contain arrays. The following error occurs:RuntimeError: No conversion rule from Int4Array(true) to connectorx::destinations::arrow::typesystem::ArrowTypeSystem.

How can I download this data?

Thanks!

[wangxiaoying]

Hi @IgorDenisenko , sorry that currently we don't support array type on arrow destination.

A temporary workaround might be getting data to pandas first and convert to arrow.

[IgorDenisenko]

@wangxiaoying, thank u!

[wonb168]

I also etl greeplun table to arrow，but have jsonb column in greeenplum，also not support，raise error： I RuntimeError: No conversion rule from JSONB(true) to connectorx::destinations::arrow::typesystem::ArrowTypeSystem.

[wangxiaoying]

I also etl greeplun table to arrow，but have jsonb column in greeenplum，also not support，raise error： I RuntimeError: No conversion rule from JSONB(true) to connectorx::destinations::arrow::typesystem::ArrowTypeSystem.

Redirect to https://github.com/sfu-db/connector-x/issues/331 for jsonb

[wonb168]

greenplum array column etl to arrow raise error: RuntimeError: No conversion rule from Int4Array(true) to connectorx::destinations::arrow::typesystem::ArrowTypeSystem.

[alexander-beedie]

Looks like this is fixed when using arrow2 in the upcoming 0.3.1 release (I just compiled the latest source, tested against postgres, and was happy to see that it appeared to work ;)