connector-x icon indicating copy to clipboard operation
connector-x copied to clipboard

read_sql(bigquery) takes very long and have error when using return_type="polars"

Open Sonycyberbiz opened this issue 2 years ago • 0 comments

What language are you using?

Python

What version are you using?

---Version info---
Polars: 0.16.9
Index type: UInt32
Platform: Darwin-22.2.0-x86_64-i386-64bit
Python: 3.7.10 (default, Feb 26 2021, 10:16:00) 
[Clang 10.0.0 ]
---Optional dependencies---
pyarrow: 7.0.0
pandas: 1.3.5
numpy: 1.20.3
fsspec: 2021.11.1
connectorx: 0.3.1
xlsx2csv: <not installed>
deltalake: <not installed>
matplotlib: 3.5.1

What database are you using?

e.g. Bigquery

What dataframe are you using?

e.g. Polars

Can you describe your bug?

https://github.com/pola-rs/polars/issues/7267

Database setup if the error only happens on specific data or data type
{'event_date': Datetime(tu='us', tz=None),
 'event_timestamp': Datetime(tu='us', tz='UTC'),
 'event_name': Utf8,
 'event_params': Utf8,
 'user_id': Utf8,
 'user_pseudo_id': Utf8,
 'device_category': Utf8,
 'country': Utf8,
 'region': Utf8,
 'city': Utf8,
 'traffic_name': Utf8,
 'traffic_source': Utf8,
 'traffic_medium': Utf8,
 'dim_affiliate': Utf8,
 'ga_session_id': Int64,
 'shop_id': Float64}

What is the error?

https://github.com/pola-rs/polars/issues/7267#issuecomment-1451249310

Sonycyberbiz avatar Mar 02 '23 03:03 Sonycyberbiz