python-bigquery-pandas
python-bigquery-pandas copied to clipboard
googleapis
Google BigQuery connector for pandas
There have been [several](https://stackoverflow.com/q/55350247/101923) [StackOverflow](https://stackoverflow.com/q/35173847/101923) [questions](https://stackoverflow.com/q/55350247/101923) about `GenericGBQException`. We should have a troubleshooting document that covers: * Common exceptions that may occur. * How to import them to catch them....
I recently learned about [Fletcher](https://fletcher.readthedocs.io/en/latest/), which provides a pandas extension dtype that is backed by pyarrow. Since it's backed by arrow, it avoids having to use the object dtype for...
We use pandas-gbq a lot for our daily analyses. It is known that memory consumption can be a pain, see e.g. https://www.dataquest.io/blog/pandas-big-data/ I have started to write a patch, which...
The latest version of nox includes https://github.com/theacodes/nox/pull/217, which adds a `venv_backend='conda'` option to create a conda environment instead of a virtualenv. It also adds a `conda_install` command, so that we...
Python 3.8 was released in October. We should start running CI against it.
I believe that the core BQ Client now allows Streaming from a DataFrame. I was wondering if we could make that an option in pandas-gbq to allow circumventing some of...
Currently the initial logs are every ~second. Could we instead implement this as a tqdm "progress bar", albeit without progress? That would be more elegant. We could also have a...
https://circleci.com/docs/2.0/contexts/#approving-jobs-that-use-restricted-contexts This new approval job feature should allow code to be reviewed before running system tests from a fork (to prevent secrets from being leaked)
[NEP 29](https://numpy.org/neps/nep-0029-deprecation_policy.html), which [the pandas community has also been following](https://github.com/pandas-dev/pandas/issues/29034#issuecomment-546432309), has a timeline for Python and NumPy supported versions. It does not have related recommendations for `pandas` and certainly not...
