beam icon indicating copy to clipboard operation
beam copied to clipboard

[Feature Request]: Enrichment Transform

Open riteshghorse opened this issue 2 years ago • 2 comments

What would you like to happen?

Implement a enrichment transform to enrich a PCollection by making a request to the external source.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • [X] Component: Python SDK
  • [ ] Component: Java SDK
  • [ ] Component: Go SDK
  • [ ] Component: Typescript SDK
  • [ ] Component: IO connector
  • [ ] Component: Beam YAML
  • [ ] Component: Beam examples
  • [ ] Component: Beam playground
  • [ ] Component: Beam katas
  • [ ] Component: Website
  • [ ] Component: Spark Runner
  • [ ] Component: Flink Runner
  • [ ] Component: Samza Runner
  • [ ] Component: Twister2 Runner
  • [ ] Component: Hazelcast Jet Runner
  • [ ] Component: Google Cloud Dataflow Runner

riteshghorse avatar Dec 15 '23 19:12 riteshghorse

Tasks to mark this complete

  • [x] Core Enrichment transform
  • [x] BigTable handler for enrichment transform
  • [x] HTTP test with Mock API

riteshghorse avatar Dec 15 '23 20:12 riteshghorse

Design doc - https://s.apache.org/enrichment-transform

riteshghorse avatar Dec 15 '23 20:12 riteshghorse