Tim Sweña (Swast)

I see gdrivefs is using `pydata-google-auth` without overriding `client_id` and `client_secret` https://github.com/fsspec/gdrivefs/blob/d374a210bf3b2cccbc2cadc3f5ecfcb5a5033bb6/gdrivefs/core.py#L96 This means it's limited to the scopes which have been approved for the pydata-auth GCP project. Currently only...

Perhaps https://ibis-project.org/reference/scalar-udfs#ibis.expr.operations.udf.scalar.builtin already gets us part of the way there? Besides scalar functions, BigQuery DataFrames also defines: * analytic ops * aggregation ops (edit: I see we provide [ibis.udf.agg.builtin](https://ibis-project.org/how-to/extending/builtin.html#aggregate-functions) for...

> 2.2.x: datetime64[D] no longer supported FWIW: this affected me too in https://github.com/googleapis/python-bigquery-dataframes/pull/492 stack trace ___________________ test_remote_function_stringify_with_ibis ___________________ [gw1] linux -- Python 3.11.6 /tmpfs/src/github/python-bigquery-dataframes/.nox/e2e/bin/python session = scalars_table_id = 'bigframes-load-testing.bigframes_testing.scalars_269e578a0cb35c2ee0eedfef3d91d3fc' ibis_client...

There's a few potential use cases embedded in this request that would be unlocked. I use the following randomly-generated newline-delimited JSON file to demonstrate these use cases: https://gist.github.com/tswast/f27c1a6082c54150e6353c9f6a2bd423 ```python import...

One more use case: ## keep rows after unnest with empty arrays It's not always desired to eliminate rows where there are no values in the array. As seen in...

@chelsea-lin is working on a JSON dtype for https://github.com/googleapis/python-db-dtypes-pandas which is blocking this for `read_gbq` support. Otherwise, we'd end up returning strings (see: https://github.com/googleapis/python-bigquery/pull/1876#issuecomment-2025562693). Regarding loads via `to_gbq`, I believe...

Thanks for the report! Thankfully uint8 fits inside int64, so it seems we should be using BigQuery INT64 columns for these types.

@anujsh61 Can you confirm if you're creating a new table or writing to one that already exists?

I think the fix for this issue needs to happen here: https://github.com/googleapis/python-bigquery-pandas/blob/d9211069f3f744d75178c102757ea519185dbcff/pandas_gbq/schema.py#L108 I suspect uint8 is hitting out "string" fallback dtype. Aside: I see we always are hitting the "table...

> The dependencies resolved with conda is very old Would you mind sharing which dependencies in particular need updating, please?