guac
guac copied to clipboard
fix queue to deliver message directly
Description of the PR
Previously all the messages were being grabbed from the queue and placed into a channel for processing. This resulted in one ingestor grabbing majority of the messages and slowing trying to drain the channels. With the direct receive of messages from the pubsub, the goCloud library can throttle the batch size as needed and each ingestor can ingest simultaneously. No functionality changes, just removed the necessary use of channels in the emitter.
PR Checklist
- [x] All commits have a Developer Certificate of Origin (DCO) -- they are generated using
-sflag togit commit. - [x] All new changes are covered by tests
- [ ] If GraphQL schema is changed,
make generatehas been run - [ ] If OpenAPI spec is changed,
make generatehas been run - [ ] If
collectsubprotobuf has been changed,make protohas been run - [x] All CI checks are passing (tests and formatting)
- [x] All dependent PRs have already been merged