Danny McCormick
Danny McCormick
There are folks out there trying to run Beam Python on Databricks [1]. While there is documentation out there for the Java SDK [2], Python is more involved because the...
Confluent Schema Registry (CSR) 6 introduces support for other Schema types like Protobuf and JSON Schema. We should adapt KafkaIO to obtain the type of Schema and configure correctly its...
There was a prior email dev thread about PubSub ordering key[1] but that was in reference to reads. It should be possible to support pubsub Write with ordering key. We...
Until this is better supported, we should warn folks away from it. See https://github.com/apache/beam/issues/31078 for a collection of issues ------------------------ Thank you for your contribution! Follow this checklist to help...
Once the summit is over I'll move this out of draft ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: -...
MQTT IO connector forPython SDK Imported from Jira [BEAM-12732](https://issues.apache.org/jira/browse/BEAM-12732). Original Jira may contain additional context. Reported by: ayush1995.
Today, if you try to submit dataflow jobs with a mix of normal pipeline options and dataflow pipeline options, it does not get submitted correctly. This is because `cfg.command` is...
Follow up now that #32528 is completed and released to create a notebook showing how to use vLLM ------------------------ Thank you for your contribution! Follow this checklist to help us...
The pymongo driver is installed by default, but as the number of IO connectors in the python sdk grows, I don't think this is the precedent we want to set. ...
This test seems to consistently flake when running against prism in https://github.com/apache/beam/pull/34612 - seeing if it will flake here with just this test on prism. I've tried reproing locally and...