beam

beam copied to clipboard

[Bug]: Some methods on DeferredSeries and DeferredDataFrame don't work right when returning single items

1

### What happened? I've been upgrading dataframe to be compliant with Pandas 2, and a new doctest in Pandas 2 revealed this bug that currently exists in Pandas 1. Whenever...

caneff

### What happened? Pipeline Options doesn't recursively get all args from children of its subclasses which means you can't effectively have extended inheritance of the PipelineOptions class in python which...

manav-glean

### What happened? There might be a race in sentence_transformers tests: ``` if os.path.exists(path + ".lock"): > os.remove(path + ".lock") E FileNotFoundError: [Errno 2] No such file or directory: '/home/runner/.cache/torch/sentence_transformers/sentence-transformers_all-mpnet-base-v2/sentence_bert_config.json.lock'...

tvalentyn

[Feature Request]: Set quota project in `beam.io.ReadFromBigQuery`

7

### What would you like to happen? This issue relates to the Python SDK, but it is probably relevant to other SDKs as well: We have a use case where...

shahar1

------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description (for example:...

johnjcasey

[Bug]: WriteToFiles in python leave few records in temp directory when writing to large number (100+) of files

16

### What happened? I am running Pipeline with WriteToFiles the destination is fetched from record and then files are written to GCP cloud Storage we found out that few of...

awadhoot-sq

Bump com.gradle.common-custom-user-data-gradle-plugin from 1.12.1 to 2.0.1

1

Bumps com.gradle.common-custom-user-data-gradle-plugin from 1.12.1 to 2.0.1. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands...

dependabot[bot]

[#30789] Add support for Flink 1.18

6

This PR tries to solve #30789 by adding a runner for Flink 1.18. So far I haven't identified any changes that need to be done beyond the version bump. ------------------------...

thebozzcl

[Feature Request]: Add support for apache pinot

1

### What would you like to happen? Can you add support for Apache Pinot https://pinot.apache.org/ ### Issue Priority Priority: 3 (nice-to-have improvement) ### Issue Components - [ ] Component: Python...

anada10

The StressTests Java KafkaIO job is flaky

2

The StressTests Java KafkaIO is failing over 50% of the time. Please visit https://github.com/apache/beam/actions/workflows/beam_StressTests_Java_KafkaIO.yml?query=is%3Afailure+branch%3Amaster to see all failed workflow runs. See also Grafana statistics: http://metrics.beam.apache.org/d/CTYdoxP4z/ga-post-commits-status?orgId=1&viewPanel=3&var-Workflow=StressTests%20Java%20KafkaIO

github-actions[bot]