python-bigquery-pandas
python-bigquery-pandas copied to clipboard
Google BigQuery connector for pandas
This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | Type | Update | |---|---|---|---|---|---|---|---| | [google-cloud-bigquery](https://redirect.github.com/googleapis/python-bigquery) | `==3.30.0` -> `==3.34.0`...
There is a substantial difference in execution time between `pandas_gbq.read_gbq` and `google.cloud.bigquery.job.query.QueryJob.to_dataframe` functions. The reason is `pandas_gbq.read_gbq` calls `rows_iter.to_dataframe` [here](https://github.com/googleapis/python-bigquery-pandas/blob/910a064620f13c8e18183c2dedd52dcf68f8d3ea/pandas_gbq/gbq.py#L535) with `dtypes=conversion_dtypes` which causes converting columns in [RowIterator.to_dataframe](https://github.com/googleapis/python-bigquery/blob/85de1a361d8bbda7ff8a20b34ffd5a0e619a1f38/google/cloud/bigquery/table.py#L2678). `conversion_dtypes` is...
The basic logic is: * If the input is a query, dry run it * If the input is a table reference, convert it to a SQL (`"SELECT * FROM...
**Is your feature request related to a problem? Please describe.** Currently, one only uses the columns parameter to re-order the list of columns and it has to exactly match the...
This may fix flaky bot issues like #904 and #905.
**Assumption**: there is currently no supported way to force `read_gbq` to use the BQ storage API. I'd be happy to be corrected if I missed something! **Is your feature request...
When I try to use `read_gbq` where I pass in the name of a view, I get a runtime error caused by an unhandled 400 error from the API. It...
Fixes #852 In the document, pandas-gbq returns `datetime64[ns]` or `object`, but in pandas2, it returns `datetime64[us]`. https://googleapis.dev/python/pandas-gbq/latest/reading.html#inferring-the-dataframe-s-dtypes 
#### Environment details - OS type and version: macOS sonoma 14.6 - Python version: 3.11.9 - pip version: I use rye instead of pip. and rye version is 0.35 -...
We're missing a unit test session that installs the geopandas extras. ``` nox > Session unit-3.12 was successful. nox > Running session cover nox > Creating virtual environment (virtualenv) using...