Erin Reeves

Results 39 comments of Erin Reeves

Classes todo modification: - [x] S3Utils - [x] CsbExtractor - [x] WebPublisher - [x] KafkaConsumer - [x] KafkaPublisher - [x] SqsConsumer - [x] Change unittests to not load config but...

What is the incoming collection_uuid in KafkaPublisher class for publish_collection and publish_granule?

Which scripts can be run locally versus have to be copied to a pod to be executed? archive_client_integration.py bucket_automation.py launch_delete_handler.py launch_e2e.py launch_kafka_publisher.py launch_pyconsumer.py sme/ sme.py smeFunc.py spatial.py sqs-to-registry/ s3_notification_handler.py

https://github.com/cedardevs/onestop-clients/pull/57

https://github.com/cedardevs/onestop-clients/pull/59

Relationships tested with scripts/launch_pyconsumer.py using copy of /etc/config/config.yml with log_level=Debug: Old payload web publisher, after transform "relationships": [{"type": {"type": "COLLECTION"}, "id": "fdb56230-87f4-49f2-ab83-104cfd073177"}], "errors": [{"title": null, "detail": null, "status": null, "code":...

Also changed SqsHandlers and S3MessageAdapter to operate/transform on a single record, and only take 1 in as a parameter. Since it already only operated on 1 record.

1508-avro-schemas branch

https://github.com/cedardevs/onestop-clients/pull/60