beam icon indicating copy to clipboard operation
beam copied to clipboard

MQTT IO connector for Python

Open damccorm opened this issue 3 years ago • 2 comments

MQTT IO connector forPython SDK

Imported from Jira BEAM-12732. Original Jira may contain additional context. Reported by: ayush1995.

damccorm avatar Jun 04 '22 21:06 damccorm

Hi. Is there any intention on following up with this idea? Or is it stale? We could definitely make use of an MQTT connector for Python or, in its defect, an External Transform that allowed us to import an unbounded PCollection to our Python pipeline. We want to use Dataflow to write to BigQuery, but our data is in MQTT instead of Pub/Sub, which is what all the documentation we found assumes. Thanks for any help you can provide

gdiazdelrio avatar Mar 20 '24 14:03 gdiazdelrio

@ahmedabu98 @damccorm do we have plans to include MQTT as a Python auto-generated x-lang wrapper ?

chamikaramj avatar Aug 22 '24 16:08 chamikaramj

Opened a quick PR to make this transform portable: #32385

@gdiazdelrio feel free to check and review it

ahmedabu98 avatar Aug 30 '24 22:08 ahmedabu98