python-bigquery-pandas
python-bigquery-pandas copied to clipboard
googleapis
Google BigQuery connector for pandas
This can help us uncover problems with conda builds and remind us to keep up-to-date packages on conda-forge. Edit: Note that this is a requirement to play nice with the...
Recent ReadTheDocs builds have been failing (due to requiring Python 3.6, which is no longer available on the ReadTheDocs environment) https://readthedocs.org/projects/pandas-gbq/builds/ That said, rather than post the full docs set...
dataframe.to_csv( csv_buffer, index=False, header=False, encoding='utf-8', date_format='%Y-%m-%d %H:%M') No harm in adding %z here for timezone. Current workaround for me is df[col] = df[col].dt.tz_localize('Australia/Sydney').tz_convert('UTC') Will you accept pull request for this...
While creating a new table using pandas, it would be nice if it can partition the table and set an partition expiry time. The python bigquery library already supports it...
The `to_gbq` function should take a `configuration` argument representing a [BigQuery JobConfiguration REST API resource](https://cloud.google.com/bigquery/docs/reference/rest/v2/Job#JobConfiguration). This would make it consistent with the [`read_gbq`](https://googleapis.dev/python/pandas-gbq/latest/api.html#pandas_gbq.read_gbq) function. **Context** Options for table creation /...
I notice in https://github.com/googleapis/python-bigquery-pandas/pull/389 that sphinx is able to render the numpy-style docstrings just fine even with the [`conf.py` from our shared templates](https://github.com/googleapis/synthtool/blob/master/synthtool/gcp/templates/python_library/docs/conf.py.j2). Still, it would be nice to use...
I am using pandas with BigQuery tables. Because pandas doesn't support boolean missing values, BigQuery BOOLEAN columns become dataframe object columns. I have to use to_gbq() table_schema to convert force...
Hello, Recently a [question](https://stackoverflow.com/questions/46344535/how-can-i-send-the-dryrun-parameter-to-pandas-read-gbq-function) featured on SO asking about running a `read_gbq` job with `dryRun` settings defined as `True`. As it turns out, for what I could [check](https://github.com/pydata/pandas-gbq/blob/master/pandas_gbq/gbq.py#L558), currently we...
This issue is about adding support to write to partitions of BigQuery's [date-partitioned tables](https://cloud.google.com/bigquery/docs/partitioned-tables). Currently, reading is supported but inserts fails during execution of `GbqConnector.delete_and_recreate`: partition is deleted but creation...
Looks like there's some issue when streaming RECORD type data to BigQuery. Here're two examples how you can reproduce this issue. Any help is appreciated! Without specifying `table_schema` arg, no...
