Sanjay Panda

Results 9 comments of Sanjay Panda

Hi @sjvanrossum, đź‘‹ Could you please take a look at this pull request when you have a moment? It introduces a new `BigQueryStorageEnrichmentHandler` for Apache Beam, which leverages the BigQuery...

Thank you @mohamedawnallah for providing additional details! 👍 I’m planning to make a few more documentation updates similar to yours. It looks like the pipeline failures aren’t related to my...

Looks like there is a need for a BQ table to make the examples pipeline to pass. ![image](https://github.com/user-attachments/assets/511aad22-6347-4f50-a5c3-d4e797375b3b) project_id = "apache-beam-testing" dataset = "beam-test" table_name = "bigquery-enrichment-test-products" -- BigQuery DDL...

> @pandasanjay – It looks like the example pipelines fail with this error: > > ``` > > from google.api_core.exceptions import TooManyRequests > E ModuleNotFoundError: No module named 'google.api_core' >...

> Have you actually seen poor performance from the existing handler in practice? Since we're usually not doing bulk reads with enrichment, its unclear to me that the storage read...

> > I’ve noticed that wherever this module is used, the Beam pipeline is skipping those tests > > @pandasanjay I found it depends mostly on the GitHub runner/workflow those...

> hey @pandasanjay, is this PR still relevant? Hi @ahmedabu98, Yes.. thanks for taking a look. I explored two approaches internally: 1. Enrichment — This implementation runs into Dataflow worker...

Hi @hangfei, I've made the requested changes. Apologies for creating a new branch and pull request—I ran into some issues with the commit history on the previous one. This pull...