Sanjay Panda
Sanjay Panda
Hi @sjvanrossum, đź‘‹ Could you please take a look at this pull request when you have a moment? It introduces a new `BigQueryStorageEnrichmentHandler` for Apache Beam, which leverages the BigQuery...
Thank you @mohamedawnallah for providing additional details! 👍 I’m planning to make a few more documentation updates similar to yours. It looks like the pipeline failures aren’t related to my...
assign set of reviewers
Looks like there is a need for a BQ table to make the examples pipeline to pass.  project_id = "apache-beam-testing" dataset = "beam-test" table_name = "bigquery-enrichment-test-products" -- BigQuery DDL...
> @pandasanjay – It looks like the example pipelines fail with this error: > > ``` > > from google.api_core.exceptions import TooManyRequests > E ModuleNotFoundError: No module named 'google.api_core' >...
> Have you actually seen poor performance from the existing handler in practice? Since we're usually not doing bulk reads with enrichment, its unclear to me that the storage read...
> > I’ve noticed that wherever this module is used, the Beam pipeline is skipping those tests > > @pandasanjay I found it depends mostly on the GitHub runner/workflow those...
> hey @pandasanjay, is this PR still relevant? Hi @ahmedabu98, Yes.. thanks for taking a look. I explored two approaches internally: 1. Enrichment — This implementation runs into Dataflow worker...
Hi @hangfei, I've made the requested changes. Apologies for creating a new branch and pull request—I ran into some issues with the commit history on the previous one. This pull...