Mike Williamson comments

Results 15 comments of


                                            Mike Williamson

[Feature Request]: Provide the Python equivalent to Java's BigQueryIO `writeProtos`

I will think more on my biggest pain points going cross-language, and provide a specific example when I remember / experience it. But for now, I'll give one pain point:...

[Feature Request]: Provide the Python equivalent to Java's BigQueryIO `writeProtos`

Thanks, @ahmedabu98 . The timestamps thing is by no means Beam's fault... that's a Google thing, and specifically a GCP thing. I know there is strong overlap. But still, Beam...

[Feature Request]: Provide the Python equivalent to Java's BigQueryIO `writeProtos`

I did try to use the StorageWrite API about 1 year ago, and I was having trouble getting it to work. That was in an Airflow job, not within Dataflow...

[Feature Request]: Provide the Python equivalent to Java's BigQueryIO `writeProtos`

OK, thanks everyone! I'm fighting other issues at the moment, but once I get a chance, I'll revisit the StorageWriteAPI and see if it can work for me.

Non-deterministic file_..._proto_rawDesc byte array generation for messages using custom options (e.g., gen_bq_schema.bq_table)

Thanks! I figured it out a bit further, and some of what I wrote above is wrong. Here are the updates: - It is *not* coming from the `gen-bq-schema` plugin...