Systemizer icon indicating copy to clipboard operation
Systemizer copied to clipboard

Consumer/processor component

Open Shmuma opened this issue 4 years ago • 3 comments

Current set of components are good to design simple web-based apps, but in practice there are more cases. For example, almost immediately I missed “consumer” or “processor” - worker which consumes MQ messages and transforms them. In general they can do multiple requests, not just transformations, for example it can consume “crawling requests” which contains domain names, perform the crawling of the website (HTTP requests) and push results into another MQ queue.

Shmuma avatar Aug 07 '21 05:08 Shmuma

Sounds good, I'll look into it.

honzaap avatar Aug 07 '21 05:08 honzaap

Hi, I'm reading more into this now and can't kinda understand what would make this "processor" component so unique. Right now, you can connect API component as a consumer, which can then send requests to another MQ, I don't see the differece.

honzaap avatar Aug 08 '21 09:08 honzaap

For example how could I build a 3 way connection as processor that consumes a queue as input, requests to other services to enrich and then pushes the result into another queue

Lockhead avatar Sep 22 '21 19:09 Lockhead