connector-x
connector-x copied to clipboard
read_sql(bigquery) takes very long and have error when using return_type="polars"
What language are you using?
Python
What version are you using?
---Version info---
Polars: 0.16.9
Index type: UInt32
Platform: Darwin-22.2.0-x86_64-i386-64bit
Python: 3.7.10 (default, Feb 26 2021, 10:16:00)
[Clang 10.0.0 ]
---Optional dependencies---
pyarrow: 7.0.0
pandas: 1.3.5
numpy: 1.20.3
fsspec: 2021.11.1
connectorx: 0.3.1
xlsx2csv: <not installed>
deltalake: <not installed>
matplotlib: 3.5.1
What database are you using?
e.g. Bigquery
What dataframe are you using?
e.g. Polars
Can you describe your bug?
https://github.com/pola-rs/polars/issues/7267
Database setup if the error only happens on specific data or data type
{'event_date': Datetime(tu='us', tz=None),
'event_timestamp': Datetime(tu='us', tz='UTC'),
'event_name': Utf8,
'event_params': Utf8,
'user_id': Utf8,
'user_pseudo_id': Utf8,
'device_category': Utf8,
'country': Utf8,
'region': Utf8,
'city': Utf8,
'traffic_name': Utf8,
'traffic_source': Utf8,
'traffic_medium': Utf8,
'dim_affiliate': Utf8,
'ga_session_id': Int64,
'shop_id': Float64}
What is the error?
https://github.com/pola-rs/polars/issues/7267#issuecomment-1451249310