onestop icon indicating copy to clipboard operation
onestop copied to clipboard

Implement produce/consume methods on onestop-python-clients

Open dneufeldcu opened this issue 4 years ago • 0 comments

Summary

As a an SME developer
I want to be able to consume and produce metadata off of Kafka topics
So that I can better integrate my domain specific code into metadata publishing workflows

Background

for CSB use case we want him to able to consume off topic to deserialize incoming parsed record message use s3 location to scrape metadata using CSB extractor and publish

Tasks

  • [x] Initial avro python classes to simplify message deser
  • [x] Deserialize an incoming granule metadata message for CSB
  • [x] Run CSBExtractor and publish spatial temporal bounds back to kafka
  • [x] Confirm metadata has add spatial temporal bounds

dneufeldcu avatar Feb 08 '21 17:02 dneufeldcu