beam

beam copied to clipboard

[Feature Request]: BQ: Allow map values to be nullable in GCP SDK BigQueryIO

3

### What would you like to happen? in this line : https://github.com/apache/beam/blob/60436605e1983d9bc34f5be4aec881124e22b13d/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryAvroUtils.java#L577 We enforce MAP types to have required values, this is a huge setback, especially that in previous versions...

assaadhjb

[Feature Request]: Expose pvalue.Row in core.py rather than pvalue.py

4

### What would you like to happen? It's semantically confusing that `Row` is defined in `pvalue.py`. `pvalue`s are abstract representations of data while `Row`s are actually concretely instantiated. It might...

hjtran

[Bug]: There have an error in 'WriteToBigQuery' after updating to 2.69

5

### What happened? For the Beam Yaml, there have an error in WriteToBQ after updating to 2.69, `ValueError: Unknow output 'error' at line 221: WriteResponseToBigQuery only has outputs []` look...

ZwxwZ

[Java]Fix infinite retry issue in BigQuery getDatasetLocation() for non-existent datasets

15

**Please** add a meaningful description for your change here ------------------------ This PR fixes #28438 where BigQuery operations would retry indefinitely when trying to access a non-existent dataset. The `BigQueryHelpers.getDatasetLocation()` method...

Suvrat1629

### What happened? Re-enable the following temporary disabled unit tests. SpannerChangeStreamErrorTest > testResourceExhaustedRetry FAILED java.lang.AssertionError at MatcherAssert.java:18 SpannerChangeStreamErrorTest > testInvalidRecordReceived FAILED java.lang.AssertionError at MatcherAssert.java:18 SpannerChangeStreamErrorTest > testUnavailableExceptionRetries FAILED java.lang.AssertionError at...

jiangzzhu

[Feature Request]: Request to use BASIC enum when calling tables.get() in BigQuery

5

### What would you like to happen? When calling BigQuery's tables.get method, today, we are retrieving FULL details (which is the default). However, this is expensive and is resulting in...

PraveenAkunuru

### What happened? See https://github.com/apache/beam/actions/runs/19908135517/job/57069740859?pr=36983 - ParDoTest$BundleFinalizationTests. testBundleFinalizationWithState - ParDoTest$StateTests. testMapStateNoReadOnComputeIfAbsentAndPutIfAbsentInsertsElement - ParDoTest$TimerTests. testOutputTimestamp - ParDoTest$TimerTests. testOutputTimestampWithProcessingTime ### Issue Failure Failure: Test is flaky ### Issue Priority Priority: 1 (unhealthy...

shunping

Fix clean up image skipping images if there were child paths

4

**Please** add a meaningful description for your change here ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]...

Abacn

Bump glob from 10.4.5 to 10.5.0 in /scripts/ci/pr-bot

3

Bumps [glob](https://github.com/isaacs/node-glob) from 10.4.5 to 10.5.0. Commits 56774ef 10.5.0 1e4e297 bin: Do not expose filenames to shell expansion See full diff in compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve...

dependabot[bot]

Bump js-yaml from 4.1.0 to 4.1.1 in /scripts/ci/pr-bot

3

Bumps [js-yaml](https://github.com/nodeca/js-yaml) from 4.1.0 to 4.1.1. Changelog Sourced from js-yaml's changelog. [4.1.1] - 2025-11-12 Security Fix prototype pollution issue in yaml merge (<<) operator. Commits cc482e7 4.1.1 released 50968b8 dist...

dependabot[bot]